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Abstract. The essence of the second law of classical thermodynamics is the 'entropy 
principle' which asserts the existence of an additive and extensive entropy function, S, 
that is defined for all equilibrium states of thermodynamic systems and whose increase 
. characterizes the possible state changes under adiabatic conditions. It is one of the few re- 

ally fundamental physical laws (in the sense that no deviation, however tiny, is permitted) 
and its consequences are far reaching. This principle is independent of models, statisti- 
cs) ■ cal mechanical or otherwise, and can be understood without recourse to Carnot cycles, 
ideal gases and other assumptions about such things as 'heat', 'temperature', 'reversible 
^ , processes', etc., as is usually done. Also the well known formula of statistical mechanics, 
| ' S — — J^plogp, is not needed for the derivation of the entropy principle. 

This contribution is partly a summary of our joint work (Physics Reports, Vol. 310, 
1-96 (1999)) where the existence and uniqueness of S is proved to be a consequence of 
certain basic properties of the relation of adiabatic accessibility among equilibrium states. 
We also present some open problems and suggest directions for further study. 
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Foreword 



At the conference "Contemporary Developments in Mathematics", hosted by the MIT and 

-»»« . Harvard University Mathematics Departments, November 16-17, 2001, one of us (E.H.L.) 
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contributed a talk with the above title. It was a review of our work |LYlj on the mathemati- 
cal foundations of classical thermodynamics. An extensive summary of |LYlj was published 
in the AMS Notices |LY2j . It was also published in |LY4j and |LY5j with additional sec- 
tions added in each. A shorter summary, addressed particularity to physicists, appeared in 
Physics Today |LY3j . We include here an expanded version of the article |LY5j . Section 
^is primarily from |LY2j but is augmented by proofs of all theorems. The present version 
■ is therefore mathematically complete, but the original paper |LYlj is recommended for ad- 

ditional insights and extensive discussions. Section is primarily from |LY4j and |LY5j . 
Section 01 is mainly from |LY3j . 

1. A Guide to Entropy and the Second Law of Thermodynamics 

This article is intended for readers who, like us, were told that the second law of ther- 
modynamics is one of the major achievements of the nineteenth century, that it is a logical, 
perfect and unbreakable law - but who were unsatisfied with the 'derivations' of the entropy 
principle as found in textbooks and in popular writings. 

A glance at the books will inform the reader that the law has 'various formulations' (which 
is a bit odd for something so fundamental) but they all lead to the existence of an entropy 
function whose reason for existence is to tell us which processes can occur and which cannot. 
An interesting summary of these various points of view is in [Uf. Contrary to convention, 
we shall refer to the existence of entropy as the second law. This, at least, is unambiguous. 
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The entropy we are talking about is that defined by thermodynamics (and not some analytic 
quantity, usually involving expressions such as — plnp, that appears in information theory, 
probability theory and statistical mechanical models). 

Why, one might ask, should a mathematician be interested in the second law of ther- 
modynamics which, historically, had something to do with attempts to understand and 
improve the efficiency of steam engines? The answer, as we perceive it, is that the law is 
really an interesting mathematical theorem about orderings on sets, with profound physi- 
cal implications. The axioms that constitute this ordering are somewhat peculiar from the 
mathematical point of view and might not arise in the ordinary ruminations of abstract 
thought. They are special, but important, and they are driven by considerations about the 
world, which is what makes them so interesting. Maybe an ingenious reader will find an 
application of this same logical structure to another field of science. 

Classical thermodynamics, as it is usually presented, is based on three laws (plus one 
more, due to Nernst, which is mainly used in low temperature physics and is not immutable 
like the others). In brief, these are: 

The Zeroth Law, which expresses the transitivity of equilibrium, and which 
is often said to imply the existence of temperature as a parametrization of 
equilibrium states. We use it below but formulate it without mentioning 
temperature. In fact, temperature makes no appearance here until almost 
the very end. 

The First Law, which is conservation of energy. It is a concept from mechan- 
ics and provides the connection between mechanics (and things like falling 
weights) and thermodynamics. We discuss this later on when we introduce 
simple systems; the crucial usage of this law is that it allows energy to be 
used as one of the parameters describing the states of a simple system. 
The Second Law. Three popular formulations of this law are: 

Clausius: No process is possible, the sole result of which is that 

heat is transferred from a body to a hotter one. 

Kelvin (and Planck): No process is possible, the sole result of which 

is that a body is cooled and work is done. 

Caratheodory: In any neighborhood of any state there are states 
that cannot be reached from it by an adiabatic process. 

All three are supposed to lead to the entropy principle (defined below). These steps 
can be found in many books and will not be trodden again here. Let us note in passing, 
however, that the first two use concepts such as hot, cold, heat, cool, that are intuitive 
but have to be made precise before the statements are truly meaningful. No one has seen 
'heat', for example. The last (which uses the term "adiabatic process", to be defined below) 
presupposes some kind of parametrization of states by points in R n , and the usual derivation 
of entropy from it assumes some sort of differentiability; such assumptions are beside the 
point as far as understanding the meaning of entropy goes. 

The basic input in our analysis of the second law is a certain kind of ordering on a set 
and denoted by 

-< 

(pronounced 'precedes'). It is transitive and reflexive as in Al, A2 below, but X -< Y and 
Y ~< X does not imply X = Y, so it is a 'preorder'. The big question is whether -< can be 
encoded in an ordinary, real-valued function on the set, denoted by S, such that if A and Y 
are related by -<, then S(X) < S(Y) if and only if X -< Y. The function S is also required 
to be additive and extensive in a sense that will soon be made precise. 

A helpful analogy is the question: When can a vector- field, V(x), on M 3 be encoded in an 
ordinary function, f(x), whose gradient is VI The well-known answer is that a necessary 
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and sufficient condition is that curly = 0. Once V is observed to have this property one 
thing becomes evident and important: It is necessary to measure the integral of V only 
along some curves - not all curves - in order to deduce the integral along all curves. The 
encoding then has enormous predictive power about the nature of future measurements of 
V. In the same way, knowledge of the function S has enormous predictive power in the 
hands of chemists, engineers and others concerned with the ways of the physical world. 

Our concern will be the existence and properties of S, starting from certain natural axioms 
about the relation -<. We present our results with slightly abridged versions of some proofs, 
but full details, and a discussion of related previous work on the foundations of classical 
thermodynamics, are given in |LYlj . The literature on this subject is extensive and it is 
not possible to give even a brief account of it here, except for mentioning that the previous 
work closest to ours is that of |Gij . and |Bnj . (see also |Coj . |D] and |RLj ) . (The situation 
is summarized more completely in |LYlj .) These other approaches are also based on an 
investigation of the relation -<, but the overlap with our work is only partial. In fact, a 
major part of our work is the derivation of a certain property (the "comparison hypothesis" 
below), which is taken as an axiom in the other approaches. It was a remarkable and largely 
unsung achievement of Giles [Gij to realize the full power of this property. 

Let us begin the story with some basic concepts. 

1. Thermodynamic System: Physically, this consists of certain specified amounts of 
certain kinds of matter, e.g., a gram of hydrogen in a container with a piston, or 
a gram of hydrogen and a gram of oxygen in two separate containers, or a gram of 
hydrogen and two grams of hydrogen in separate containers. The system can be in 
various states which, physically, are equilibrium states. The space of states of the 
system is usually denoted by a symbol such as T and states in T by X, Y, Z, etc. 

Physical motivation aside, a state-space, mathematically, is just a set - to begin with; 
later on we will be interested in embedding state-spaces in some convex subset of some M" +1 , 
i.e., we will introduce coordinates. As we said earlier, however, the entropy principle is quite 
independent of coordinatization, Caratheodory's principle notwithstanding. 

2. Composition and scaling of states: The notion of Cartesian product, T± x r 2 cor- 
responds simply to the two (or more) systems being side by side on the laboratory 
table; mathematically it is just another system (called a compound system), and we 
regard the state space Ti x r 2 as the same as r 2 x Ti. Likewise, when forming 
multiple compositions of state spaces, the order and the grouping of the spaces is 
immaterial. Thus (ri x r 2 ) x r 3 , Ti x (r 2 x r 3 ) and Ti x T 2 x T3 are to be identified 
as far as composition of state spaces is concerned. Points in Ti x r 2 are denoted 
by pairs (X, Y), and in Ti x • ■ ■ x Tjy by iV-tuples (Xx,...,X/v) as usual. The 
subsystems comprising a compound system are physically independent systems, but 
they are allowed to interact with each other for a period of time and thereby alter 
each other's state. 

The concept of scaling is crucial. It is this concept that makes our thermodynamics 
inappropriate for microscopic objects like atoms or cosmic objects like stars. For each 
state-space T and number A > there is another state-space, denoted by r( A ) with 
points denoted by AX. This space is called a scaled copy of T. Of course we identify 
rW = r and IX = X. We also require (r( A ))M = and //(AX) = QuA)X. The 

physical interpretation of when T is the space of one gram of hydrogen, is simply 
the state-space of A grams of hydrogen. The state AX is the state of A grams of 
hydrogen with the same 'intensive' properties as X, e.g., pressure, while 'extensive' 
properties like energy, volume, etc., are scaled by a factor A (by definition). 

For any given T we can form Cartesian product state spaces of the type r( Al ) x r( Aa ) x 
• • • x r( Ajv ). These will be called multiple scaled copies of T. 
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The notation should be regarded as merely a mnemonic at this point, but later on, 
with the embedding of T into M n+1 , it will literally be Ar = {XX : X € T} in the usual 
sense. 

3. Adiabatic accessibility: Now we come to the ordering. We say X ~< Y (with X and 
Y possibly in different state-spaces) if Y is adiabatically accessible from X according 
to the definition below. Different state spaces can occur, e.g., if there is mixing or a 
chemical reaction between two states of a compound system to produce a state in a 
third system. 

What does this mean? Mathematically, we are just given a list of pairs X -< Y. There 
is nothing more to be said, except that later on we will assume that this list has certain 
properties that will lead to interesting theorems about this list, and will lead, in turn, to 
the existence of an entropy function, S characterizing the list. 

The physical interpretation is quite another matter. In text books a process taking X 
to Y is usually called adiabatic if it takes place in 'thermal isolation', which in turn means 
that 'no heat is exchanged with the surroundings'. Such concepts (heat, thermal etc.) ap- 
pear insufficiently precise to us and we prefer the following version, which is in the spirit 
of Planck's formulation of the second law |Plj and avoids those concepts. Our definition of 
adiabatic accessibility might at first sight appear to be less restrictive than the usual one, 
but as discussed in |LYlj . pp. 29 and 54, in the end anything that we call an adiabatic 
process (meaning that Y is adiabatically accessible from X) can also be accomplished in 
'thermal isolation' as the concept is usually understood. Our definition has the great virtue 
(as discovered by Planck) that it avoids having to distinguish between work and heat - or 
even having to define the concept of heat. We emphasize, however, that the theorems do 
not require agreement with our physical definition of adiabatic accessibility; other defini- 
tions are conceivably possible. We emphasize also that we do not care about the temporal 
development involved in the state change; we only care about the net result for the system 
and the rest of the universe. 

A state Y is adiabatically accessible from a state X, in symbols X ~<Y, if it 
is possible to change the state from X to Y by means of an interaction with 
some device consisting of some auxiliary system and a weight, in such a way 
that the auxiliary system returns to its initial state at the end of the process 
whereas the weight may have risen or fallen. 

The role of the 'weight' in this definition is merely to provide a particularly simple source 
(or sink) of mechanical energy. Note that an adiabatic process, physically, does not have to 
be gentle, or 'static' or anything of the kind. It can be arbitrarily violent and destructive, 
so long as the system is brought back to equilibrium! The 'device' need not be a well- 
defined mechanical contraption. It can be another thermodynamic system, and even a 
gorilla jumping up and down on the system, or a combination of these - as long as the 
device returns to its initial state. The device can have intelligence, e.g., it can contain a 
clever scientist whose strategy depends on the progress of the experiment. Only the initial 
state X and the final state Y matter. 

An example might be useful here. Take a pound of hydrogen in a container with a piston. 
The states are describable by two numbers, energy and volume, the latter being determined 
by the position of the piston. Starting from some state, X, we can take our hand off the 
piston and let the volume increase explosively to a larger one. After things have calmed 
down, call the new equilibrium state Y. Then X -< Y, Question: Is Y -< X true? Answer: 
No. To get from Y to X adiabatically we would have to use some machinery and a weight, 
with the machinery returning to its initial state, and there is no way this can be done. Using 
a weight we can, indeed, recompress the gas to its original volume, but we will find that the 
energy is then larger than its original value. 



THE MATHEMATICAL STRUCTURE OF THE SECOND LAW OF THERMODYNAMICS 



5 



Let us write 

X -<-< Y if X ■< Y but not Y < X (written Y -fr X) . 

In this case we say that we can go from X to Y by an irreversible adiabatic process. If 
X ~< Y and Y -< X we say that X and Y are adiabatically equivalent and write 

X ~ y . 

Equivalence classes under ~ are called adiabats. 

4. Comparability: Given two states X and y in two (same or different) state-spaces, 
we say that they are comparable if X -< Y or y -< X (or both). This turns out to 
be a crucial notion. Two states are not always comparable; a necessary condition 
is that they have the same material composition in terms of the chemical elements. 
Example: Since water is H 2 and the atomic weights of hydrogen and oxygen are 1 
and 16 respectively, the states in the compound system of 2 gram of hydrogen and 
16 grams of oxygen are comparable with states in a system consisting of 18 grams 
of water (but not with 11 grams of water or 18 grams of oxygen). 

Actually, the classification of states into various state-spaces is done mainly for conceptual 
convenience. The second law deals only with states, and the only thing we really have to 
know about any two of them is whether or not they are comparable. Given the relation 
-< for all possible states of all possible systems, we can ask whether this relation can be 
encoded in an entropy function according to the following: 

Entropy principle. There is a real-valued function on all states of all systems (including 
compound systems), called entropy and denoted by S such that 

a) MONOTONICITY: When X and Y are comparable states then 

X ~< Y if and only if S(X) < S(Y) . (1) 

b) ADDITIVITY AND EXTENSIVITY: If X and Y are states of some (possibly different) 
systems and if (X, Y) denotes the corresponding state in the compound system, then 
the entropy is additive for these states, i.e., 

S(X,Y) = S(X) + S(Y) . (2) 

S is also extensive, i.e., for or each A > and each state X and its scaled copy 
XX G T (A) , (defined in 2. above) 

S(XX) = XS(X) . (3) 

A formulation logically equivalent to a), not using the word 'comparable', is the following 
pair of statements: 

X ~ y S(X) = S(Y) and 

X ^ y S(X) < S(Y) . (4) 

The last line is especially noteworthy. It says that entropy must increase in an irreversible 
adiabatic process. 

The additivity of entropy in compound systems is often just taken for granted, but it is 
one of the startling conclusions of thermodynamics. First of all, the content of additivity, 
(2), is considerably more far reaching than one might think from the simplicity of the 
notation. Consider four states X, X' ,Y,Y' and suppose that X -< Y and X' ~< Y' . One 
of our axioms, A3, will be that then (X, X') -< (Y,Y'), and (2) contains nothing new or 
exciting. On the other hand, the compound system can well have an adiabatic process in 
which (X, X') -< (y y') but X -ft Y . In this case, (2) conveys much information. Indeed, by 
monotonicity, there will be many cases of this kind because the inequality S(X) + S(X') < 
S(Y) + S(Y') certainly does not imply that S(X) < S(Y). The fact that the inequality 
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S(X) + S(X') < S(Y) + S(Y') tells us exactly which adiabatic processes are allowed in 
the compound system (among comparable states), independent of any detailed knowledge 
of the manner in which the two systems interact, is astonishing and is at the heart of 
thermodynamics. The second reason that (2) is startling is this: Prom (1) alone, restricted 
to one system, the function S can be replaced by 295 and still do its job, i.e., satisfy 
(1). However, (2) says that it is possible to calibrate the entropies of all systems (i.e., 
simultaneously adjust all the undetermined multiplicative constants) so that the entropy 
Si 5 2 for a compound x T 2 is S\^{X, Y) = Si(X) + S^OO, even though systems 1 and 2 
are totally unrelated! 

We are now ready to ask some basic questions: 

Ql: Which properties of the relation -< ensure existence and (essential) uniqueness of 5? 
Q2: Can these properties be derived from simple physical premises? 
Q3: Which convexity and smoothness properties of S follow from the premises? 
Q4: Can temperature (and hence an ordering of states by "hotness" and "coldness") be 
defined from S and what are its properties? 

The answer to question Ql can be given in the form of six axioms that are reasonable, 
simple, 'obvious' and unexceptionable. An additional, crucial assumption is also needed, but 
we call it a 'hypothesis' instead of an axiom because we show later how it can be derived 
from some other axioms, thereby answering question Q2. 

Al. Reflexivity. X ~ X. 

A2. Transitivity. If X ~< Y and Y -< Z, then X <Z. 

A3. Consistency. If X ■< X' and Y ■< Y\ then (X,Y) -< (X',Y'). 

A4. Scaling Invariance. If A > and X -< Y, then XX -< XY. 

A5. Splitting and Recombination. X ~ ((1 - X)X, XX) for all < A < 1. Note that 

the two state-spaces are different. If X € T, then the state space on the right side is 
r (i-A) xr (A) 

A6. Stability. If (X,eZq) ~< (Y,eZi) for some Zq,Z\ and a sequence of e's tending to 
zero, then X -< Y . This axiom is a substitute for continuity, which we cannot assume 
because there is no topology yet. It says that 'a grain of dust cannot influence the 
set of adiabatic processes'. 

An important lemma is that (A1)-(A6) imply the cancellation law, which is used in many 
proofs. It says that for any three states X, Y, Z 

(X, Z)<{Y,Z)^X <Y (5) 

Proof. We show that (X, Z) -< (Y,Z) implies (X, \Z) -< (Y, \Z) and hence (X,±Z) -< 
(Y, i^Z) for all n = 1, 2, . . . . By the stability axiom, A6, this implies X -< Y . 
The argument for (X, \Z) < (Y, \Z) is as follows: 

(X, \Z) ~ (±A, \X, \Z) (by A5 and A3) 

< (±A, iy, \Z) (by (X, Z) < (Y, Z), using A3 and A4) 
-< (|y, \Y, \Z) (again by (X, Z) -< (Y, Z), using A3 and A4) 
{Y,\Z) (by A5 and A3). 



A 



The next concept plays a key role in our treatment. 

CH. Definition: We say that the Comparison Hypothesis, (CH), holds for a state-space 
T if all pairs of states in T are comparable. 

Note that A3, A4 and A5 automatically extend comparability from a space T to certain 
other cases, e.g., X -< ((1 - X)Y,XZ) for all < A < 1 if X -< Y and X ~< Z. On the 
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other hand, comparability on T alone does not allow us to conclude that A is comparable 
to ((1 — X)Y,XZ) if A -< Y but Z -< X. For this, one needs CH on the product space 
r (1 ~ A) x T (A) , which is not implied by CH on F. 

The significance of A1-A6 and CH is borne out by the following theorem: 

THEOREM 1 (Equivalence of entropy and A1-A6, given CH). The following are 
equivalent for a state-space T; 

(i) The relation ~< between states in (possibly different) multiple scaled copies ofT e.g., 

x • • • x r( Ajv \ is characterized by an entropy function, S, on T in the 

sense that 

(X 1 X 1 ,X 2 X 2 ,...) ~< (X[X[, X 2 X' 2 , . . . ) (6) 
is equivalent to the condition that 

J>W)<E A ^W (7) 

* 3 

whenever 

I> = £^- (8) 

i 3 

(ii) The relation -< satisfies conditions A1-A6, and CH holds for every multiple scaled 
copy ofT. 

This entropy function on T is unique up to affine equivalence, i.e., S{X) — > aS{X) + B, 
with a > 0. 

Proof. The implication (i) =>■ (ii) is obvious. To prove the converse and also the uniqueness 
of entropy, pick two reference points Xq -<-< X\ in T. (If there are no such points then 
entropy is simply constant and there is nothing more to prove.) To begin with, we focus 
attention on the 'strip' {X : Xq -< X -< X\\. (See Fig. 1.) In the following it is important 
to keep in mind that, by axiom A5, X ~ ((1 — A) A, AA), so A can be thought of as a point 
in r( 1 " A ) x rW, for any < A < 1. 

Consider uniqueness first. If S is any entropy function satisfying (i), then necessarily 
S{Xq) < S(X\), and 5(A) e [S(Xq), S(Xi)]. Hence there is a unique A € [0,1] such that 

S(X) = (1 - X)S(X ) + AS(Ai). (9) 

By (i), in particular additivity and extensivity of 5 and the fact that A ~ ((1 — AA, AA), 
this is equivalent to 

A~ ((1-A)X 0) AX 1 ). (10) 

Because ijTHjl is a property of Ao,Ai,A which is independent of 5, and because of the 
equivalence of and Q for any entropy function, any other entropy function, S' say, 
must satisfy © with the same X but with S(Xq) and S(Xi) replaced by S'(Xq) and S'(Xi) 
respectively. This proves that entropy is uniquely determined up to the choice of the en- 
tropy for the two reference points. A change of this choice clearly amounts to an affine 
transformation of the entropy function. 

The equivalence of (fTT7f> and (JHl provides also a clue for constructing entropy: Using only 
the properties of the relation -< one must produce a unique A satisfying lflO)l . The uniqueness 
of such a A, if it exists, follows from the more general fact that 

((1 - A)A , AAi) -< ((1 - A')A , A' Ax) (11) 

is equivalent to 

A < A'. (12) 
This equivalence follows from Aq Ai, using A4, A5 and the cancellation law, (jSJ. 
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To find A we consider 



sup{A : ((1 - A)A , AAi) -< A} (13) 



and 



A min = inf{A : A ^ ((1 - X)X , XX!)} (14) 

Making use of the stability axiom, A6, one readily shows that the sup and inf are achieved, 
and hence 

((1 — A max )A , X mSLX Xi) -< X (15) 

and 

^((l-Anu^Xo.AndnXi). ( 16 ) 

Hence, by A2, 

((1 — A max )Xo, X max Xi) -< ((1 — A m i n )ATo, A m i n Xi) (17) 
and thus, (contrary to what the notation might suggest) 

Amax 5; A m j n . (18) 

That A max cannot be strictly smaller than A m i n follows from the comparison hypothesis for 
the state spaces r( 1_A) x T^: If A > A max , then ((1 - X)Xq,XXi) -< X can not hold, and 
hence, by (CH) the alternative, i.e., 

X^ {(1-X)X ,XX 1 ) (19) 

must hold. Likewise, A < A m i n implies 

{(1-X)X ,XX 1 )^X. (20) 

Hence, if A max < A m i n , we have produced a whole interval of A's satisfying lfT0|l . This 
contradicts the statement made earlier that lfT0)l specifies at most one A. At the same time 
we have shown that A = A m ; n = A max satisfies (jTU|) . Hence we can define the entropy by (JHJ , 
assigning some fixed, but arbitrarily chosen values S(Xq) < S(Xi) to the reference points. 
For the special choice S(Xq) = and S(Xi) = 1 we have the basic formula for S (see 
Fig. 1): 





5(A) 


= sup { A 


: ((l-A)A ,AAx 




or, equivalently, 












S(X) 


= inf {A 


Ax ((I-A)Aq, 


AAx)} . 



(21) 



(22) 



The existence of A satisfying © may can be shown also for X outside the 'strip', i.e., for 
A ~< Xq or Ai -< A, by simply interchanging the roles of A, Ao and X\ in the considerations 
above. For these cases we use the convention that (A, — 1") -< Z means A -< (Y,Z), and 
(Y, 0Z) = Y. If X -< A , A in Eq. © will be < 0, and if X x -< X it will be > 1. 

Our conclusion is that every A £ T is equivalent, in the sense of ~, to a scaled composition 
of the reference points Ao and X\. By A5 this holds also for all points in multiply scaled 
copies of T, where by A4 we can assume that the total 'mass' in (JJJ is equal to 1. Moreover, 
by the definition of 5, the left and right sides of are just the corresponding compositions 
of S(Xq) and 5*(Ai). To see that S characterizes the relation on multiply scaled copies it is 
thus sufficient to show that (|TT|) holds if and only if 

(1 - X)S(X ) + AS(Ai) < (1 - X')S(X ) + X'SiXt). (23) 

Since S(Xq) < S(Xi) this is just the equivalence of (jlT|) and lfT2|l that was already men- 
tioned. ■ 
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Figure 1. The entropy of X is, according to Eq. pi) , determined by the 
largest amount of X\ that can be transformed adiabatically into X, with the 
help of a complementary amount of Xq. The coordinates U (energy) and 
V (work coordinates) are irrelevant for Eq. (21), but are important in the 
context of the simple systems to be discussed later. 

Remarks. 1. The formula ff^Tfl for entropy is reminiscent of an old definition of heat by 
Laplace and Lavoisier in terms of the amount of ice that a body can melt: S(X) is the 
maximal amount of substance in the state X\ that can be transformed into the state X 
with the help of a complimentary amount in the state Xq. According to l(2*2*|) this is also the 
minimal amount of substance in the state X\ that is needed to transfer a complementary 
amount in the state X into the state Xq. Note also that any A satisfying (jlH]) is an upper 
bound and any A satisfying lj27)|) is a lower bound to S(X). 

2. The construction of entropy in the proof above requires CH to hold for the two-fold 
scaled products iS 1- ^ x T x . It is not sufficient that CH holds for T alone, but in virtue of 
the other axioms it necessarily holds for all multiple scaled products of T if it holds for the 
two-fold scaled products. 

3. Theorem 1 states the properties a binary relation on a set must have in order to be 
characterized by a function satisfying our additivity and extensivity requirements. The set 
is here the union of all multiple scaled products of T. In a quite different context, this 
mathematical problem was discussed by I.N. Herstein and J. Milnor already in 1953 [HMJ 
for what they call a 'mixture set' , which in our terminology corresponds to the union of 
all two-fold scaled products r( 1_A ) x T x . The main result of their paper is very similar to 
Theorem 1 for this special case. 

Theorem 1 extends to products of multiple scaled copies of different systems, i.e. to general 
compound systems. This extension is an immediate consequence of the following theorem, 
which is proved by applying Theorem 1 to the product of the system under consideration 
with some standard reference system. 

Theorem 2 (Consistent entropy scales). Assume that CH holds for all compound sys- 
tems. For each system T let Sr be some definite entropy function on T in the sense of 
Theorem 1. Then there are constants or and B(T) such that the function S, defined for all 
states of all systems by 

S(X) = a r S r {X) + B(T) (24) 
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for I £ T, satisfies additivity (2), extensivity (3), and monotonicity (1) in the sense that 
whenever X and Y are in the same state space then 

X -< Y if and only if S(X) < S{Y) . (25) 

Proof. The entropy function denned by l(2"T|) will in general not satisfy additivity and ex- 
tensivity, because the reference points can be quite unrelated for the different state spaces 
T. Note that l(2*T|l both fixes the states where the entropy is defined to be (those that are 

A A 

~ Xq) and also an arbitrary entropy unit for T by assigning the value 1 to the states ~ X\. 
To obtain an additive and extensive entropy it is first necessary to choose the points where 
the entropy is in a way that is compatible with these requirements. 

This can be achieved by considering the formal vector space spanned by all systems and 
choosing a Hamel basis of systems {T a } in this space such that every system can be written 
uniquely as a scaled product of a finite number of the T a 's. Pick an arbitrary point in each 
state space in the basis, and define for each state space V a corresponding point Ap € T as 
a composition of these basis points. Then 

X riX r 2 = (X ri ,X T2 ) and X tr = tX r . (26) 

Assigning the entropy to these points Xr is clearly compatible with additivity and exten- 
sivity. 

To ensure that the entropy unit is the same for all state spaces, choose some fixed space 
To with fixed reference points Zq -<-< Z\. For any T consider the product space r x Tq and 
the entropy function Srxr defined by (|2T|) in this space with reference points (Xr, Zq) and 
(Xr, Z\). Then X i— > Srxr (X, Zq) defines an entropy function on T by the cancellation law 
((HI). It it is additive and extensive by the properties (|26|l of Xr, and by Theorem 1 it is is 
related to any other entropy function on T by and affine transformation. 

An explicit formula for this additive and extensive entropy is 

S(X) = sup{A: (X r ,AZi)} H (X,XZ ) (27) 

= inf{A: (X,AZoH(*r,AZi)}, (28) 

because 

(X, Z ) £ ((1 - X)(X r , Z ), A(X r , Z x )) (29) 

is equivalent to 

{X,XZ ) ~ (X r ,AZi)). (30) 

by the cancellation law. ■ 

Theorem 2 is what we need, except for the question of mixing and chemical reactions, 
which is treated at the end and which can be put aside at a first reading. In other words, 
as long as we do not consider adiabatic processes in which systems are converted into each 
other (e.g., a compound system consisting of a vessel of hydrogen and a vessel of oxygen is 
converted into a vessel of water), the entropy principle has been verified. If that is so, what 
remains to be done, the reader may justifiably ask? The answer is twofold: First, Theorem 
2 requires that CH holds for all systems, including compound ones, and we are not content 
to take this as an axiom. Second, important notions of thermodynamics such as 'thermal 
equilibrium' (which will eventually lead to a precise definition of 'temperature' ) have not 
appeared so far. We shall see that these two points (i.e., thermal equilibrium and CH) are 
not unrelated. 

As for CH, other authors, |Cij . |Buj . |Coj and |RL| essentially postulate that it holds for all 
systems by making it axiomatic that comparable states fall into equivalence classes. (This 
means that the conditions X -< Z and Y ~< Z always imply that X and Y are comparable: 
likewise, they must be comparable if Z -< X and Z -< Y .) Replacing the concept of a 
'state-space' by that of an equivalence class, the comparison hypothesis then holds in these 
other approaches by assumption for all state-spaces. We, in contrast, would like to derive CH 
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from something that we consider more basic. Two ingredients will be needed: The analysis 
of certain special, but commonplace systems called 'simple systems' and some assumptions 
about thermal contact (the 'zeroth law') that will act as a kind of glue holding the parts of 
a compound systems in harmony with each other. 

A Simple System is one whose state-space can be identified with some open convex 
subset of some M n+1 with a distinguished coordinate denoted by U, called the energy, and 
additional coordinates V € K n , called work coordinates. The energy coordinate is the way 
in which thermodynamics makes contact with mechanics, where the concept of energy arises 
and is precisely defined. The fact that the amount of energy in a state is independent of 
the manner in which the state was arrived at is, in reality, the first law of thermodynamics. 
A typical (and often the only) work coordinate is the volume of a fluid or gas (controlled 
by a piston); other examples are deformation coordinates of a solid or magnetization of a 
paramagnetic substance. 

Our goal is to show, with the addition of a few more axioms, that CH holds for simple 
systems and their scaled products. In the process, we will introduce more structure, which 
will capture the intuitive notions of thermodynamics; thermal equilibrium is one. 

Here, for the first time in our theory, coordinates are introduced. Up to now state spaces 
were fairly abstract things; there was no topology. Calculus, for example, played no role 
— contrary to the usual presentation of classical thermodynamics. For simple systems we 
are talking about points in W 1 and we can thus talk about 'open sets', 'convexity', etc. In 
particular, if we take a point A and scale it to tX then this scaling now has the usual 
concrete meaning it always has in R n , namely, all coordinates of X are multiplied by the 
positive number t. The notion of +, as in X + Y, had no meaning heretofore, but now it 
has the usual one of addition of vectors in W 1 . 

First, there is an axiom about convexity: 

A7. Convex combination. If A and Y are states of a simple system and t € [0, 1] then 

(tX, (1 - t)Y) ■< tX + (1 - t)Y , (31) 

in the sense of ordinary convex addition of points in M n+1 . A straightforward con- 
sequence of this axiom (and A5) is that the forward sectors 

A x := {Y E r : X ~< Y} (32) 

of states A in a simple system T are convex sets. (See Fig. 2.) 

Another consequence is a connection between the existence of irreversible processes and 
Caratheodory's principle ((Hj, 0) mentioned above. 

Lemma 1. Assume (A1)-(A7) for V C M. N and consider the following statements: 

(a) Existence of irreversible processes: For every X G T there is aY £ T with X -<-< Y . 

(b) Caratheodory's principle: In every neighborhood of every X € T there is a Z € T 
with I/Z. 

Then (a) (b) always. If the forward sectors in T have interior points, then (b) =>■ (a) . 

Proof. Suppose that for some A € T there is a neighborhood, Mx of A such that Mx is 
contained in Ax- (This is the negation of the statement that in every neighbourhood of 
every A there is a Z such that A ~< Z is false.) Let Y £ Ax be arbitrary. By the convexity 
of Ax, which is implied by axiom A7, A is an interior point of a line segment joining Y and 
some point Z e Mx, and, again by A7, 

(tZ, (1 - t)Y) -< X ~ (tX, (1 - t)X) (33) 

for some t € (0, 1). But we also have that (tX, (1 - t)X) -< (tZ, (1 - t)X) since Z £ A x . 
This implies, by the cancellation law and A4, that Y -< X, Thus we conclude that for some 
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X, we have that X -< Y implies X ~ Y. This contradicts (a). In particular, we have shown 
that (a) =Kb). 

Conversely, assuming that (a) is false, there is a point Xq whose forward sector is given 
by Ax = {Y : Y ~ Xq}. Let X be an interior point of Ax , i.e., there is a neighborhood of 
X, Mx, which is entirely contained in Ax . All points in Mx are adiabatically equivalent 
to Xq, however, and hence to X, since X E Mx- Thus, (b) is false. ■ 



A U 




V 



Figure 2. The coordinates U and V of a simple system. The state space 
(bounded by dashed line) and the forward sector Ax (shaded) of a state X 
are convex, by axiom A7. The boundary of Ax (full line) is an adiabat, cf. 
Theorem 3. 

We need three more axioms for simple systems, which will take us into an analytic detour. 
The first of these establishes (a) above. 

A8. Irreversibility. For each X € T there is a point Y G T such that X -<-< Y. (This 
axiom is implied by A14 below, but is stated here separately because important 
conclusions can be drawn from it alone.) 

A9. Lipschitz tangent planes. For each X G T the forward sector Ax = {Y £ T : 
X -< Y} has a unique support plane at X (i.e., Ax has a tangent plane at X). The 
tangent plane is assumed to be a locally Lipschitz continuous function of X, in the 
sense explained below. 

A10. Connectedness of the boundary. The boundary dAx (relative to the open set 
r) of every forward sector Ax C V is connected. (This is technical and conceivably 
can be replaced by something else.) 

Axiom A8 plus Lemma 1 asserts that every X lies on the boundary dAx of its forward 
sector. Although axiom A9 asserts that the convex set, Ax, has a true tangent at X only, it 
is an easy consequence of axiom A2 that Ax has a true tangent everywhere on its boundary. 
To say that this tangent plane is locally Lipschitz continuous means that if X = (U°,V°) 
then this plane is given by 



n 

U - U ° + J2Pi(X)(V i -V°)=0. 
1 



(34) 
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with locally Lipschitz continuous functions Pj. The function Pj is called the generalized 
pressure conjugate to the work coordinate V{ . (When V$ is the volume, Pi is the ordinary 
pressure.) 

Lipschitz continuity and connectedness is a well known guarantee for uniqueness of the 
solution to the coupled differential equations 

§±-(y) = -P j (u{V),V) forj = l,...,n (35) 

which describes the boundary dAx of Ax- 

With these axioms one can now prove that the comparison hypothesis holds for the state 
space T of a simple system: 

Theorem 3 (CH for simple systems). If X and Y are states of the same simple system, 
then either X -<Y orY -< X. Moreover, X ~ Y <^=> Y € dA x X G dA Y . 

Proof. The proof is carried out in several steps, which provide also further information about 
the forward sectors. 

Step 1: Ax is closed. We have to prove that if Y 6 T is on the boundary of Ax then Y is 
in A x . For this purpose we can assume that the set Ax has full dimension, i.e., the interior 
of Ax is not empty. If, on the contrary, Ax lay in some lower dimensional hyperplane 
then the following proof would work, without any changes, simply by replacing T by the 
intersection of T with this hyperplane. 

Let W be any point in the interior of Ax- Since Ax is convex, and Y is on the boundary 
of Ax, the half-open line segment joining W to Y (call it [W, Y), bearing in mind that 
Y [W, Y)) lies in Ax- The prolongation of this line beyond Y lies in the complement of 
Ax and has at least one point (call it Z) in T. (This follows from the fact that V is open 
and Y 6 V.) For all sufficiently large integers n the point Y n defined by 

^Y n + ^Z = Y (36) 

belongs to [W, Y). We claim that (X, ^Z) -< (Y, jY). If this is so then we are done because, 
by the stability axiom, A6, X -< Y. 

To prove the last claim, first note that (X, \Z~) ~< (Y n , \Z~) because X -< Y n and by axiom 
A3. By scaling, A4, the convex combination axiom A7, and (3.10) 

(Yn, \Z) = {jkYn, ^Z) ~< ^Y . (37) 

But this last equals (1", ±Y) by the splitting axiom, A5. Hence (X, \Z) -< (Y, ±Y). 

Step 2: Ax has a nonempty interior. Ax is a convex set by axiom A7. Hence, if Ax had 
an empty interior it would necessarily be contained in a hyperplane. [An illustrative picture 
to keep in mind here is that Ax is a closed, (two-dimensional) disc in M 3 and X is some 
point inside this disc and not on its perimeter. This disc is a closed subset of IR 3 and X is 
on its boundary (when the disc is viewed as a subset of M 3 ). The hyperplane is the plane in 
M 3 that contains the disc] 

Any hyperplane containing Ax is a support plane to Ax at X, and by axiom A9 the 
support plane, Tlx, is unique, so Ax C ILx- If Y € Ax, then Ay C Ax C by transitivity, 
A2. By the irreversibility axiom A8, there exists a Y £ Ax such that Ay ^ Ax, which 
implies that the convex set Ay C 11^, regarded as a subset of n^, has a boundary point in 
Tlx- If Z £ Tlx is such a boundary point of Ay, then Z £ Ay because Ay is closed. By 
transitivity, Az C Ay C n^, and Az / because Ay ^ Ax- 

Now Ay, considered as a subset of Tlx, has an (n — l)-dimensional supporting hyperplane 
at Z (because Z is a boundary point). Call this hyperplane TL' Z . Since Az C Ay, Tl' z is a 
supporting hyperplane for Az, regarded as a subset of n^- Any n-dimensional hyperplane 
in M. n+1 that contains the (n — l)-dimensional hyperplane Tl' z C II^ clearly supports Az at 
Z, where Az is now considered as a convex subset of M n+1 . Since there are infinitely many 
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such n- dimensional hyperplanes in M. n+ , we have a contradiction to the uniqueness axiom 
AO. 

Step 3: Y G dAx => X G dAy and hence Ax = Ay ■ We bring here only a sketch of the 
proof; for details see |LYlj . Theorems 3.5 and 3.6. First, using the convexity axiom, A7, 
and the existence of a tangent plane of Ax at X, one shows that the boundary points of 
Ax can be written as (ux(V), V), where ux is a solution to the equation system l[35|). Here 
V runs through the set 

px = {V : (U, V) G dA x for some U}. (38) 

Secondly, the solution of (|35|) that passes through X is unique by the Lipschitz condition 
for the pressure. In particular, if Y G dAx, then ux must coincide on py C px with the 
solution uy through Y, The proof is completed by showing that px = Py) this uses that 
px is connected by axiom A10 and also that px is open. For the latter it is important that 
no tangent plane of Ax can be parallel to the [/-axis, because of axiom A9. 

Step 4 : X £ Ay => Y G Ax- Let Z be some point in the interior of Ay and consider the 
line segment L joining X to Z. If we assume X £ Ay then part of L lies outside Ay, and 
therefore L intersects dAy at some point W G dAy. By Step 3, Ay and A\y are the same 
set, so W -< Z (because Y -< Z). We claim that this implies X -< Z also. This can be seen 
as follows: 

We have W = tX + (1 - t)Z for some t G (0, 1). By A7, A5, W <Z, and A3 

(tX, (1 - t)Z) -< W ~ (tW, (1 - t)W) ~< (tW, (1 - t)Z). (39) 

By transitivity, A2, and the cancellation law, iX -< tW. By scaling, A4, X -< W and 
hence, by A2, X -< Z. 

Since Z was arbitrary, we learn that Interior (Ay) C Ax- Since Ax and ^4y are both 
closed by Step 1, this implies Ay C Ax and hence, by Al, Y G ^4x- 

Sfep 5: X ~ Y y G 8A X . By Step 1, A x is closed, so dA x C A x . Hence, if 
y G dAx, then X -< y. By Step 3, Y G cMx is equivalent to X G cL4y, so we can also 
conclude that y -< X. The implication <= is thus clear. On the other hand, X ~ Y implies 
A x = Ay by Axiom A2 and thus 8A X = dAy. But Y G cMy by Axioms Al, A8 and 

A 

Lemma 1. Thus the adiabats, i.e., the ~ equivalence classes, are exactly the boundaries of 
the forward sectors. ■ 

Remark. It can also be shown from our axioms that the orientation of forward sectors 
w.r.t. the energy axis is the same for all simple systems (cf. |LYlj . Thms. 3.3 and 4.2). 
By convention we choose the direction of the energy axis so that the the energy always 
increases in adiabatic processes at fixed work coordinates. When temperature is defined 
later, this will imply that temperature is always positive. Since spin systems in magnetic 
fields are sometimes regarded as capable of having 'negative temperatures' it is natural to 
ask what in our axioms excludes such situations. The answer is: Convexity, A7, together 
with axiom A8. The first would imply that if the energy can both increase and decrease 
in adiabatic processes, then also a state of maximal energy is in the state space. But such 
a state would also have maximal entropy and thus violate A8. From our point of view, 
'negative temperature' states should not be regarded as true equilibrium states. 

Before leaving the subject of simple systems let us remark on the connection with Caratheo- 
dory's development. The point of contact is the fact that X G dAx- We assume that Ax 
is convex and use transitivity and Lipschitz continuity to arrive, eventually, at Theorem 3. 
Caratheodory uses Frobenius's theorem, plus assumptions about differentiability to conclude 
the existence - locally - of a surface containing X. Important global information, such as 
Theorem 3, are then not easy to obtain without further assumptions, as discussed, e.g., in 

m 



THE MATHEMATICAL STRUCTURE OF THE SECOND LAW OF THERMODYNAMICS 



15 




Y 



V 



Figure 3. This figure illustrates Theorem 3, i.e., the fact that forward 
sectors of a simple system are nested. The bottom figure shows what could, 
in principle, go wrong — but does not. 

The next topic is thermal contact and the zeroth law, which entails the very special 
assumptions about -< that we mentioned earlier. It will enable us to establish CH for 
products of several systems, and thereby show, via Theorem 2, that entropy exists and 
is additive. Although we have established CH for a simple system, T, we have not yet 
established CH even for a product of two copies of T. This is needed in the definition of 
S given in (9). The S in (9) is determined up to an affine shift and we want to be able to 
calibrate the entropies (i.e., adjust the multiplicative and additive constants) of all systems 
so that they work together to form a global S satisfying the entropy principle. We need 
five more axioms. They might look a bit abstract, so a few words of introduction might be 
helpful. 

In order to relate systems to each other, in the hope of establishing CH for compounds, 
and thereby an additive entropy function, some way must be found to put them into contact 
with each other. Heuristically, we imagine two simple systems (the same or different) side 
by side, and fix the work coordinates (e.g., the volume) of each. Bring them into 'thermal 
contact' (e.g., by linking them to each other with a copper thread) and wait for equilibrium 
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to be established. The total energy U will not change but the individual energies, U\ and 
U2 will adjust to values that depend on U and the work coordinates. This new system (with 
the thread permanently connected) then behaves like a simple system (with one energy 
coordinate) but with several work coordinates (the union of the two work coordinates). 
Thus, if we start initially with X = (Ui,Vi) for system 1 and Y = (f/^V^) for system 2, 
and if we end up with Z = (U, Vi, V2) for the new system, we can say that (X, Y) -< Z. This 
holds for every choice oiU\ and U2 whose sum is U . Moreover, after thermal equilibrium is 
reached, the two systems can be disconnected, if we wish, and once more form a compound 
system, whose component parts we say are in thermal equilibrium. That this is transitive 
is the zeroth law. 

Thus, we cannot only make compound systems consisting of independent subsystems 
(which can interact, but separate again), we can also make a new simple system out of two 
simple systems. To do this an energy coordinate has to disappear, and thermal contact does 
this for us. This is formalized in the following two axioms. 

All. Thermal join. For any two simple systems with state-spaces Ti and T 2 , there is 
another simple system, called the thermal join of Ti and T 2 , with state-space 

A12 = {(17, V 1 ,V 2 ):U = U 1 + U 2 with (U u Vi) G Ti , (U 2 , V 2 ) G T 2 } . (40) 

If X = (U u Vx) € T 1; and Y = (U 2 , V 2 ) G T 2 we define 

9(X,Y):=(U 1 + U 2 ,V 1 ,V2)eA 12 . (41) 

It is assumed that the formation of a thermal join is an adiabatic operation for the 
compound system, i.e., 

(X,Y) -<0(X,Y). (42) 

A12. Thermal splitting. For any point Z G Ai 2 there is at least one pair of states, 
X G Ti, Y G T 2 , such that 

Z = 6{X,Y) ~ (X,Y) (43) 

Definition. If 9(X,Y) ~ (X,Y) we say that the states X and Y are in thermal equilibrium 
and write 

X ~ Y . (44) 

All and A12 together say that for each choice of the individual work coordinates there 
is a way to divide up the energy U between the two systems in a stable manner. A12 is the 
stability statement, for it says that joining is reversible, i.e., once the equilibrium has been 
established, one can cut the copper thread and retrieve the two systems back again, but 
with a special partition of the energies. This reversibility allows us to think of the thermal 
join, which is a simple system in its own right, as a special subset of the product system, 
Ti x T 2 , which we call the thermal diagonal. 

Axioms All and A12, together with the general axioms A4, A5, A7 and our assumption 
that a compound state (A, Y) is identical to (Y,X), imply that the relation ~ is refelxive 
and symmetric: 

LEMMA 2 . (i) X ~ X. 

(ii) IfX^Y, thenY^X. 
Proof, (i) Let X = (17, V). Then, by All, 

(X,X)^9(X,X) = (2U,V,V). (45) 
By A12, this is, for some U' and U" with U' + U" = 2U, 

~((U',V),(U",V)), (46) 
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which, using A4, A7, and finally A5, is 

~ 2(i([/', V), \{U", V)) -< 2{\(U' + U"), V) = 2X~ (X, X). (47) 

Hence (X, X) ~ 9(X,X), i.e., X ~ X. 

(ii) By All and A12 we have quite generally 

9(X, Y) = (U x + U Y , V x , V y ) ~ ((C/', Vx), (17", W)) (48) 

for some U', U" with f/' + U" = Ux + £7y = Uy + f/x- Since composition of states is 
commutative (i.e., (A,B) = (B,A), as we stated when explaining the basic concepts) we 
obtain, using All again, 

(([/', V X ), (U", V Y )) = ((U", V Y ), (U', V x )) -< (U" + U', V Y , V x ) = 9(Y, X). (49) 

Interchanging X and Y we thus have 9(X,Y) ~ 9(Y, X). Hence, if X ~ Y, i.e., (X,Y) ~ 
6(X,Y), then (F,X) = (X,F) ~ 0{X,Y) ~6{Y,X), i.e., y ~ X. U 

T 

REMARK. Instead of presenting a formal proof of the symmetry of ~, it might seem more 
natural to simply identify 9(X,Y) with 6(Y,X) by an additional axiom. This could be 
justified both from the physical interpretation of the thermal join, which is symmetric in 
the states (connect the systems with a copper thread), and also because both joins have the 
same energy and the same work coordinates, only written in different order. But since we 
really only need that 9(X, Y) ~ 9(Y, X) and this follows from the axioms as they stand, it 
is not necessary to postulate such an identification. Likewise, it is not necessary to identify 
9(9(X, Y),Z) with 9(X,9(Y, Z)) formally by an axiom, because we do not need it. It is 
possible, using the present axioms, to prove 9(9(X,Y), Z) ~ 9(X, 9(Y, Z)), but we do not 
do so since we do not need this either. 

We now come to the famous zeroth law, which says that the thermal equilibrium is 
transitive, and hence (by Lemma 2) an equivalence relation. 

A13. Zeroth law of thermodynamics. If X ~ Z and Z ~ Y then X ~ Y. 

The zeroth law is often taken to mean that the equivalence classes can be labeled by an 
'empirical' temperature, but we do not want to mention temperature at all at this point. It 
will appear later. 

There are two more axioms about thermal contact, but before we state them we draw 
two simple conclusions from All, A12 and A13. 

LEMMA 3. (i) If X ~Y, then XX ~ fiY for all X, \i > 0. 
(ii) IfX~YandZ~X, then Z ~ 9{X,Y). 

Proof, (i) By the zeroth law, A13, it suffices to show that XX ~ X and fiY ~ Y . For this 
we use similar arguments as in Lemma 2(i): 

{XX, X) ~< 9(XX, X) = ((1 + X)U, XV, V) ~ {{XU 1 , XV), (U", V)) (50) 
with XU' + U" = (1 + X)U. By A4, A7, and A5 this is 
A (l+A)(^(^ni^(^)) ■< (l+\)(jh;(W+U"),V) = (1+X)X A (XX, X). (51) 
(ii) By the zeroth law, it suffices to show that X ~ 9(X,Y), i.e., 

(X,9(X,Y)) ^ 6(X,9(X,Y)). (52) 
The left side of this equation is -< the right side by All, so we need only show 

9(X,9(X,Y))^(X,9(X,Y)). (53) 
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Now, since A ~ Y and hence also 2 A ~ Y by (i), the right side of (|53|) is 

(X,9(X,Y)) ~ (AT, = ((X,X),Y) & (2X,Y) ~ 9{2X,Y) = (2Ux + Uy,2Vx,V y ). 

(54) 

(Here A5, A4 and A3 have been used, besides (i)). On the other hand, using A12 twice 
as well as A3, we have for some X' = (U',V X ), X" = (U",V X ) and Y' = (U'",V Y ) with 
U' + U" + U'" = 2U X + U Y : 

9(X, 9(X, Y)) A (X' , (X",Y')) = ((A', X"), Y 1 ) . (55) 

By convexity A7 and scaling A4, as above, this is 

-< (X' + X",Y') ~< 9(X' + X" , Y') = (2U X + U Y ,2Vx,V Y ). (56) 

But this is ~ (X,9{X,Y)) by JSJ. ■ 

We now turn to the remaining two axioms about thermal contact. 

A14 requires that for every adiabat (i.e., an equivalence class w.r.t. ~) there exists at 
least one isotherm (i.e., an equivalence class w.r.t. ~), containing points on both sides of 
the adiabat. Note that, for each given A, only two points in the entire state space T are 
required to have the stated property. This assumption essentially prevents a state-space 
from breaking up into two pieces that do not communicate with each other. Without it, 
counterexamples to CH for compound systems can be constructed, cf. |LYlj . Section 4.3. 
A14 implies A8, but we listed A8 separately in order not to confuse the discussion of simple 
systems with thermal equilibrium. 

A15 is a technical and perhaps can be eliminated. Its physical motivation is that a suffi- 
ciently large copy of a system can act as a heat bath for other systems. When temperature 
is introduced later, A15 will have the meaning that all systems have the same temperature 
range. This postulate is needed if we want to be able to bring every system into thermal 
equilibrium with every other system. 

A14. Transversality. If T is the state space of a simple system and if X G T, then there 
exist states Ao ~ Xi with Xq ~<-< X -<-< Xi. 

A15. Universal temperature range. If Ti and I?2 are state spaces of simple systems 
then, for every X € T\ and every V belonging to the projection of T2 onto the space 
of its work coordinates, there is a Y £ l"^ with work coordinates V such that A ~ Y. 

The reader should note that the concept 'thermal contact' has appeared, but not tem- 
perature or hot and cold or anything resembling the Clausius or Kelvin-Planck formulations 
of the second law. Nevertheless, we come to the main achievement of our approach: With 
these axioms we can establish CH for products of simple systems (each of which satisfies 
CH, as we already know). The proof has two parts. In the first, we consider multiple scaled 
copies of the same simple system and use the thermal join and in particular transversality to 
reduce the problem to comparability within a single simple system, which is already known 
to hold by Theorem 3. The basic idea here is that with X, Xq,X\ as in A14, the states 
((1 — A)Ao, AAi) and ((1 — A)A, AA) can be regarded as states of the same simple system 
and are, therefore, comparable. This is the key point needed for the construction of S , ac- 
cording to (9). The importance of transversality is thus brought into focus. In the second 
part we consider products of different simple systems. This case is more complicated and 
requires all the axioms A1-A14, in particular the zeroth law, A13. 

lemma 4 (CH in multiple scaled copies of a simple system). For any simple system V , all 
states of the form (A1Y1, A2Y2 • • • ) with Yi E V and Y2i Aj fixed are comparable. 

Proof. By scaling invariance of the relation -< (Axiom A4) we may assume that Aj = 1. 
Now suppose Yi, . . . , Yn, Y[, . . . , Y' M £ T, and Ai, . . . , Aat, X[, . . . , X' M G R with J2i = 
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Figure 4. Transversality, A14, requires that on on each side of the adia- 
bat through any point X there are points, Xq and X\, that are in thermal 
equilibrium with each other. 



Aj- = 1. We shall show that for some Xq,Xi € T with Xq -<-< X\ and some A, A' € R 

(Aiyi,...^^) ~ ((l-A)X ,AXi), (57) 

(A / 1 Y 1 ',...,A , M il f ) ~ ((l-A')*o,A'*i). (58) 

This will prove the lemma, since we already know from the equivalence of tfTT|> and (|T2|) 
that the right sides of (|5T|) and JSHj) are comparable. 

It was already noted that if Xq -<~< X\ and Xq ~ X\, then every X in the 'strip' 
Y,(X ,Xi) := {X : Xq ~< X ~< X{\ is comparable to ((1 - A)X ,AXi) for any < A < 1, 
due to the axioms A5, All, A12, and Theorem 3. This implies in the same way as in the 
proof of Theorem 1 that X is in fact adiabatically equivalent to ((1 — X)Xq, XX±) for some A. 
(Namely, A = A max , defined by f!3|l .) Moreover, if each of the points Yj., Y2 • • • >^m_ 1 ,Y^ 
is adiabatically equivalent to such a combination of a common pair of points Xq -<-< X% 
(which need not be in thermal equilibrium), then Eqs. 1|57|) and (|58|1 follow easily from the 
recombination axiom A5. The existence of such a common pair of reference points is proved 
by the following stepwise extension of 'local' strips defined by points in thermal equilibrium. 

By the transversality property, A4, the whole state space V can be covered by strips 
X[ i} ) with -<-< X^ and xjp ~ . Here i belongs to some index set. Since 
all adiabats dAx with IgT are relatively closed in T we can even cover each X (and hence 

r) with the open strips ■= f2( x o\ x ?) = i x ■ X® « x -<-< X®}- Moreover, any 

o 

compact subset, C, of T is covered by a finite number of such strips i = 1, . . . , K , and 

o o 

if C is connected we may assume that Yli H YU+l / I n particular, this holds if C is some 
polygonal path connecting the points Yi, . . . , Yjy, Y[, . . . , Y' M - 

By Theorem 3, the points X^ , x[ 1} . . . X^ K) , x[ K) , can be ordered according to the 
relation -<, and there is no restriction to assume that 

X® ^ Xt 1] « x ? ^ Af (59) 
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Let Xq = Xq 1 ^ denote the 'smallest' and X\ = x[ the 'largest' of these points. We 
claim that every one of the points Yi, . . . , Yjy, Y[, . . . , Y' M is adiabatically equivalent to a 
combination of Xq and X\. This is based on the following general fact: 
Suppose Xq -<^Xx, X -<-< X[ and 

X 1 ^{(1-X 1 )X ,X 1 X' 1 ), X ^((1-X )X ,X X 1 ). (60) 

If 

X ^((1-X)X ,XX 1 ), (61) 



then 
with 

and if 

then 

with 



X^((l-^X ,(iX[) (62) 

^ 1 — Ao + AoAi ' ^ ^ 

X^((l-X')X' ,X'X[), (64) 

X&dl-tfXo^'Xi) (65) 



// — — + (66) 
1 — Ao + AoAi 

The proof of l(62|) and l(65|) is simple arithmetics, using the splitting and recombination 
axiom, A5, and the cancellation law, Eq. ((3). Applying this successively for i = 1, . . . , K 
with X = X^\ Xi = Xf\ X = X[ = X[ i+1) , proves that any X G E(X^ , x[ K) ) 

is adiabatically equivalent to a combination of X$ = X^ and X\ = x[ K \ As already 
noted, this is precisely what is neded for (|57jl and l(58|) . ■ 

By Theorem 1, the last lemma establishes the existence of an entropy function S within 
the context of one simple system T and its scaled copies. Axiom A7 implies that S is a 
concave function of X = (U, V) G T, i.e., 

(1 - X)S(U, V) + XS(U', V) < 5((1 - X)U + XU', (1 - X)V + XV). (67) 

Moreover, by All and A12 and the properties of entropy described in Theorem 1 (i), 

(U, V) ~ ([/', V) ^ S(U, V) + S(U', V') = max[S(W, V) + S(U + U' -W, V% (68) 

w 

For a given T the entropy function is unique up to a mutiplicative and an additive constant 
which are indetermined as long as we stay within the group of scaled copies of T. The next 
task is to show that the multiplicative constants can be adjusted to give a universal entropy 
valid for copies of different systems, i.e. to establish the hypothesis of Theorem 2. This is 
based on the following. 

LEMMA 5 (Existence of calibrators) . IfT\ andT2 are simple systems, then there exist states 
Xq, X\ G T\ and Yq,Y\ G T2 such that 

Xq^Xx and Y ^ Yy (69) 

and 

(*o,yi)~(*i,y ). (70) 



The significance of this lemma is that it allows us to fix the multiplicative constants by 
the condition 

Si(Xo) + S 2 (Yi) = Sipfi) + S 2 (Y ) . (71) 
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Proof of Lemma 5. The proof of this lemma is not entirely simple and it involves all the 
axioms A1-A15. Consider the simple system A12 obtained by thermally joining Ti and T 2 . 
Let Z be some arbitrary point in A 12 and consider the adiabat dAz- Any point in dAz is 
by Axiom A12 adiabatically equivalent to some pair (X, Y) G 1^ x T 2 . There are now two 
alternatives. 

• For some Z there are two such pairs, (X ,Yi) and (Aq,y ) such that X -<~< X\. 
Since (Xq, Y\) ~ Z ~ (X%, Yq), this implies Yq -« Y\ and we are done. 

• (X,Y) ~ (X, Y) with X ~ Y and X ~ Y always implies X ~ X (and hence also 
Y ~ Y), 

The task is thus to exclude the second alternative. 

The second alternative is certainly excluded if the thermal splitting of some Z = (U, V±, V2) 
in A12 is not unique. Indeed, if U = U\ + U 2 = U\ + U 2 with U\ < U\ and Z ~ (X, Y) ~ 
(X, Y) with X = (U U Vl), X = (Ui, Tq), Y = (U 2 , V 2 ) and Y = (U 2 , V 2 ), then X <^ X and 
Y -<-< Y. Hence we may assume that for every Z = (U, Vi,V 2 ) € A12 there are unique U\ 

and U 2 with U x + U 2 = U and Z ~ ((Lq, lq), (C/ 2 , V2)). 

Consider now some fixed Z £ A12 with corresponding thermal splitting (X,Y), X G Iq, 
F G r 2 . We shall now show that the second alternative above leads to the conclusion that 
all points on the adiabat dAz are in thermal equilibrium with each other. By the zeroth 
law (Axiom A13) and since the domain of work coordinates corresponding to the adiabat 
dAz is connected (by Axiom A10), it is sufficient to show this for all points with a fixed 
work coordinate V\ and all points with a fixed work coordinate V 2 . 

The second alternative means that if Z £ dAg has the thermal splitting (X, Y), then X ~ 
X and y ~ y. For a given work coordinate V\ there is a unique X = (Cq, V\) € dA^. (Its 
energy coordinate is uniquely determined as a solution of the partial differential equations 
for the adiabat, cf. Step 3 in the proof of Theorem 3.) Hence the thermal splitting of each 
points Z with fixed work coordinate V\ has the form (X,Y), and Y ~ X for all such Y. By 
the zeroth law, all y's are in thermal equilibrium with each other (since they are in thermal 
equilibrium with a common X), and hence, by the zeroth law and Lemma 3, all the points 
6(X, y) are in thermal equilibrium with each other. In the same way one shows that all 
points in dAg with fixed V 2 are in thermal equilibrium with each other. 

To complete the proof we now show that if a simple system, in particular A12, contains 
two points that are not in thermal equilibrium with each other, then there is at least one 
adiabat that contains such a pair. The case that all points in A12 are in thermal equilibrium 
with each other can be excluded, since by A15 it would imply the same for T\ and T 2 and 
thus the thermal splitting would not be unique, contrary to assumption. (Note, however, 
that a world where all systems are in thermal equilibrium with each other is not in conflict 
with our axiom system. The entropy would then be an affine fuction of U and V for all 
systems. In this case, the first alternative above would always hold.) 

In our proof of the existence of an adiabat with two points not in thermal equilibrium we 
shall make use of the already established entropy function S for the simple system T = A12 
which characterizes the adiabats in T and moreover has the properties (|HT|) and (|68[1. 

The fact that S characterizes the adiabats means that if 1Z C M. denotes the range of S 
on T then the sets 

E a = {X £T : S(X) =a}, a G K (72) 

are precisely the adiabats of T. Furthermore, the concavity of S — and hence its continuity 
on the connected open set T — implies that 1Z is connected, i.e., 1Z is an interval. 

Let us assume now that for any adiabat, all points on that adiabat are in thermal equilib- 
rium with each other. We have to show that this implies that all points in T are in thermal 
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equilibrium with each other. By the zeroth law, A3, and Lemma 2 (i), ~ is an equiva- 
lence relation that divides T into disjoint equivalence classes. By our assumption, each such 
equivalence class must be a union of adiabats, which means that the equivalence classes are 
represented by a family of disjoint subsets of 1Z. Thus 

n = (J K a (73) 

where X is some index set, 1Z a is a subset of 1Z, lZ a D TZp = for a ^ (5, and E a ~ E T if 
and only if a and r are in some common 7Z a . 

We will now prove that each 1Z a is an open set. It is then an elementary topological fact 
(using the connectedness of V) that there can be only one non-empty 7Z a , i.e., all points in 
r are in thermal equilibrium with each other and our proof will be complete. 

The concavity of S(U, V) with respect to U for each fixed V implies the existence of an 
upper and lower [/-derivative at each point, which we denote by 1/T+ and 1/T_, i.e., 

(1/T±)(U, V) = ± lim e- 1 [S(U ± s, V) - S(U, V)}. (74) 

e\0 

Eq. ((SHJ) implies that X ~ Y if and only if the closed intervals [T-(X),T + (X)] and [T-{Y),T+(Y)] 
are not disjoint. Suppose that some 1Z a is not open, i.e., there is a £ lZ a and either a se- 
quence o"i > o"2 > 03 • • • , converging to a or a sequence o\ < 02 < 03 < • • • converging to a 
with tTj ^ lZ a . Suppose the former (the other case is similar). Then (since T± are monotone 
increasing in U by the concavity of S) we can conclude that for every Y G E ai and every 

XeE a 

T_(Y) >T + (X). (75) 

We also note, by the monotonicity of T± in U, that (|75|l necessarily holds if Y G E^ and 
^ > hence (1) holds for all Y £ E^ for any /jl > a (because fjj \ a). On the other hand, 
if t < a 

T + (Z)<T_(X) (76) 
for Z £ E T and X E E a . This contradicts transversality, namely the hypothesis that there 
is t < a < 11, Z e E T ,Y e En such that [T_(Z), T+(Z)] D [T_(F), T+(y)] is not empty. ■ 

With the aid of Lemma 5 we now arrive at our chief goal, which is CH for compound 
systems. 

Theorem 4 (Entropy principle in products of simple systems). The comparison 
hypothesis CH is valid in arbitrary compounds of simple systems. Hence, by Theorem 2, the 
relation ~< among states in such state-spaces is characterized by an entropy function S. The 
entropy function is unique , up to an overall multiplicative constant and one additive constant 
for each simple system under consideration. 

Proof. Let T\ and T2 be simple systems and let Xq,X\ £ T± and Yq, Y% £ T2 be points with 
the properties described in Lemma 5. By Theorem 1 we know that for every X £ V± and 

y £ r 2 

X^((l-X 1 )X ,X 1 X 1 ) and Y ~ ((1 - X 2 )Y , X 2 Y 1 ) (77) 
for some Ai and A2. Define Zq = (Xq,Yq) and Z\ = (Xi,Y%). It is then simple arithemtics, 
making use of lj7T)|) besides Axioms A3-A5, to show that 

(X,Y)^((1-X)Z ,XZ 1 ) (78) 

with A = ^(Ai + A2). By the equivalence of lfTT|) and lff2*|l we know that this is sufficient for 
comparability within the state space Ti x T2. 

Consider now a third simple system and apply Lemma 3 to A12 X T3, where A12 is 
the thermal join of Ti and I?2. By Axiom A12 the reference points in A12 are adiabatically 
equivalent to points in T± x T2, so we can repeat the reasoning above and conclude that 



THE MATHEMATICAL STRUCTURE OF THE SECOND LAW OF THERMODYNAMICS 



23 



all points in (T x x T 2 ) x T 3 are comparable. By induction, this extends to an arbitrary 
products of simple systems. This includes multiple scaled products, because by Lemma 3 
and Theorem 1, every state in a multiple scaled product of copies of a simple system T is 
adiabatically equivalent to a state in a single scaled copy of T. ■ 

remark. It should be emphasized that Theorem 4 contains more than the Entropy Principle 
for compounds of simple systems. The core of the theorem is an assertion about the compa- 
rability of all states in any state space composed of simple systems. (Note that the entropy 
principle would trivially be true if no state was comparable to any other state.) Combin- 
ing Lemma 5 and Theorem 4 we can even assert that certain compound states in different 
state spaces are comparable: What counts is that the total 'mass' of each simple system 
that enters the compound is the same for both states. For instance, if Ti and r 2 are two 
simple systems, and X\, . . . , X N ,X[, . . . , X' N , 6 Ti, Yi, . . . , Y M , Y{, . . . , Y' M , G T 2 , then Z = 
(AiXi, . . . , \ N X N ,n{Yx, HmYm) is comparable to W = {\'iX' x , . . . , \' N ,X' N ,,ii' x Y{, Mm'^M') 
provided Y, \ = Y Yl Mfc = Yl f^'ii an d in this case Z ~< W if and only if S{Z) < S(W). 

At last, we are now ready to define temperature. Concavity of S (implied by A7), Lipschitz 
continuity of the pressure and the transversality condition, together with some real analysis, 
play key roles in the following, which answers questions Q3 and Q4 posed at the beginning. 

Theorem 5 (Entropy defines temperature). The entropy, S, is a concave and con- 
tinuously differentiable function on the state space of a simple system. If the function T is 
defined by 

T := (§u)v 

then T > and T characterizes the relation ~ in the sense that X ~ Y if and only if 
T(X) = T(Y). Moreover, if two systems are brought into thermal contact with fixed work 
coordinates then, since the total entropy cannot decrease, the energy flows from the system 
with the higher T to the system with the lower T . 

Remark. The temperature need not be a strictly monotone function of U ; indeed, it is not 
so in a 'multiphase region' (see Fig. 5). It follows that T is not always capable of specifying 
a state, and this fact can cause some pain in traditional discussions of the second law - if it 
is recognized, which usually it is not. 

Proof of Theorem 5. The complete proof is rather long and we shall not bring all details here. 
They can be found in }LYl| (Lemma 5.1 and Theorems 5.1-5.4 .) As in the proof of Lemma 
5, concavity of S(U, V) implies the existence of the upper and lower partial derivatives of 
S with respect to U and hence of the upper and lower temperatures T± defined by dJ. 
Moreover, as also noted in the proof of Lemma 5, 

x^y [r_(x),T + (A)]n[r_(y),r + (F)] ^0. (80) 

The main goal is to show that T_ = T + = T, and that T is a continuous function of X. 

Step 1: T + andT_ are locally Lipschitz continuous on adiabats. The essential input here 
is the local Lipschitz continuity of the pressure, i.e., for each X 6 V and each r > there is 
a constant C = C(X,r) such that 

\P(X) -P(Y)\ < C\X-Y\ (81) 

if \X — Y\ < r. The assertion is that 

\T + (X) -T + (Y)\ <c\X -Y\ (82) 

for some c = c(A, r), if \X — Y\ < r and Y G dAx, together with the analogous equation 
forT_). 
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Figure 5. Isotherms in the (U,V) plane near the triple point (L=liquid, 
G=gas, S=solid) of a simple system. (Not to scale). In the triple point 
region the temperature is constant, which shows that an isotherm need not 
have codimension one. 



As in the proof of Theorem 3, Step 3, the adiabatic surface through X = (Uq, Vq) is given 
by (ux{V), V) where ux is the solution to the system of differential equations 

Fin 

— = -Pi, i = l,...,n (83) 

with the inital condition u(Vq) = Uq. Let us denote this solution by uq, and consider for 
e > also the solution u e with the initial condition u(Vq) = Uq + e. This latter solution 
determines the adiabatic surface through X £ = {Uq + e,Vq) (for V sufficiently close to Vq, 
so that (u(V),V) eT). 

Let So denote the entropy on (uq(V),V) and S £ the entropy on (u e (V),V). Then, by 
definition, 

rr ITT 1- £ V u e(Vo) -^O(^O) ,oa-\ 

T + (U , Vq) = hm _ - = hm - (84) 

and 

u £ {V) - uq(V) - 



T + (uo{V),V) = hm = T + (Uo,Vq) 

slO D e — Dq 



1 + lim • 

40 



(85) 



To prove l(H^|l it suffices to show that for all nonnegative e close to and V close to Vq 

U ^ V) - U £ ° {V) - £ <D\V-V \. (86) 

for some D. This estimate (with D = 2C) follows from JHB, using (l83ll to write u e (V) - 
u £ (Vq) and uq(V) — uq(q) as line integrals of the pressure. See |LYlj . p. 69. 

Step 2: T + (X) > T-(X) T + and T_ are constant on dAx- This step relies on 
concavity of entropy, continuity of T± on adiabats (Step 1), and last but not least, on the 
zeroth law. Without the zeroth law it is easy to give counterexamples to the assertion. 

If T + (X) > T_(X), but T + is not constant, then by continuity of T± on adiabats there 
exist Y,Z with Y ~ Z ~ X, T+(Y) < T + {Z) but [T^(Y),T + (Y)} n [T_(Z), T+(Z)] ^ 0, 
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i.e., Y ~ Z. Now it is a general fact about a concave function, in particular U h- > S(U,V), 
that the set of points where it is differentiable, i.e., where T + (U, V) = T_(U, V) = T(U, V), 
is dense. Moreover, if U\ > U2 > ■ ■ ■ is a sequence of such points converging to U, then 
T(Ui,V) converges to T + (U,V). Using continuity of T + on the adiabat, we conclude that 
there exists a W such that T + {W) = T^{W) = T(W), but T+(Y) < T(W) < T + (Z). 
This contradicts the zeroth law, because such a W would be in thermal equilibrium with 
Z (because T(W) G [T_(Z),T+(Z)]) but not with Y (because T(Y) <£ [T^(Y),T + (Y)]). In 
the same way one leads the assumption that T_ is not constant on the adiabat dAx to a 
contradiction. 

Step 3: T + = T_. Assume T+(X) > T-{X) for some A. Then, by Step 2, T+ and T_ 
are constant on the whole adiabat dAx- Now by concavity and monotonicity of S in U 
(cf. the remark following the proof of Theorem 3) we have T + (Y) < T_(Z) if S(Uy, Vy) < 
S(Uz, Vz), Vy = Vz- Hence, if Z is such that 

Y -<-< Z and Vy = V z for some Y ~ X, (87) 

then T+(Jf) < T_{Z) < T + (Z). Likewise, if is such that 

Z' -<-< y' and Fy/ = V z > for some y' ~ X, (88) 

then 

t_(z') < t+(z') < r_(x) < r + (X) < r_(z) < r+(z). (89) 

This means that no Z satisfying (|H7|l can be in thermal equilibrium with a Z' satisfying 
JHHl- In the case that every point in the state space has its work coordinates in common 
with some point on the adiabat dAx, this violates the transversality axiom, A14. 

Using axiom A5 we can also treat the case where the projection of the adiabat dXx onto 
the work coordinates, does not cover the whole range of the work coordinates for T, i.e., 
when 

p x := {V : (U, V) G 8A X for some U} + {V : (U, V) G V for some U} =: p{T). (90) 

One considers a line of points (U, V) G V with V fixed on the boundary of px in p(F). One 
then shows that a gap between the upper and lower temperature of X, i.e., T_(X) < T + (X), 
implies that points with these work coordinates V can only be in thermal equilibrium with 
points on one side of the adiabat dAx, in contradiction to A15 and the zeroth law. See 
(EH, P- 72 for the details. 

Step 4 : T is continuous. By Step 3 T is uniquely defined and by Step 1 it is locally 
Lipschitz continuous on each adibat, i.e., 

\T{X) -T{X')\<c\X - X'] (91) 

if X ~ X and X and Y both lie in some ball of sufficiently small radius. Moreover, 
concavity of S and the fact that T + = T_ = T imply that T is continuous along each line 
l v = {(U,V) : (u,v) G r}. 

Let now Xoo, X%, X%, . . . be points in T such that Xj — > Xoo as j — ► oo. We write 
Xj = (Uj,Vj), we let Aj denote the adiabat dAxj, we let Tj = T(Xj) and we set lj = 
{{U,V 3 ):(U,V 3 )eT}. 

By axiom A9, the slope of the tangent of Ax, i.e., the pressure P(X), is locally Lipschitz 
continuous. Therefore for Xj sufficiently close to X^ we can assume that each adiabat Aj 
intersects in some point, which we denote by Yj. S ince | Xj — A^oo I — ^ j — > oo , we 
have that \Yj — ► Aoo| as well. In particular, we can assume that all the Aj and Yj lie in 
some small ball around Aoo so that (fTTTf) applies. Now 

\T{Xj) - T(A 00 )j < \T(Xj) - T{Yj)\ + \T{Yj) - T(A 00 )|, (92) 

and as j — » oo, T{Yj) ~ ^(Aqo) — > because Yj and A^ are in l^. Also, T(Xj) — T(Yj) — > 
because |T(AA - T(3^)| < c|Aj - < c|X,- - A^l + c\Yj - A^J. 



26 



ELLIOTT H. LIEB AND JAKOB YNGVASON 



Step 5: S is continuously differentiable. The adiabat through a point X € T is character- 
ized by the once continuously differentiable function, ux(V), on W 1 . Thus, S(ux(V),V) is 
constant, so (in the sense of distributions) 

Since 1/T = dS/dU is continuous, and dux/dVj = —Pj is Lipschitz continuous, we see that 
dS/dVj is a continuous function and we have the well known formula 

dS Pj 

w t = ~T' (94) 

Step 6: Energy flows from 'hot' to 'cold'. Let X = (Ux,Vx) and Y = (Uy,Vy) be two 
states of simple systems and assume that T(X) > T(Y). By Axioms All and A12 

(X,Y)^9(X,Y)^(X',Y') (95) 

with X' = (U X ',V X ), Y' = (U Y >,V Y ) and 

U x > + U Y > =U X + U Y . (96) 

Moreover, X' ~ Y' and hence, by (f^TTf) and Step 3 

T{X') = T(Y') = T*. (97) 

We claim that 

T(X) >T*> T(Y). (98) 

(At least one of these inequalities is strict because of the uniqueness of temperature for 
each state.) Suppose that inequality lf98|) failed, e.g., T* > T(X) > T(Y). Then we would 
have that Ux' > Ux and Uy 1 > Uy and at least one of these would be strict (by the strict 
monotonicity of U with respect to T, which follows from the concavity and differentiability 
of S). This pair of inequalities is impossible in view of (|96|l . 

Since T* satisfies (|98f . the theorem now follows from the monotonicity of U with respect 
to T. U 

Prom the entropy principle and the relation 

T = (dS/dU)- 1 (99) 

between temperature and entropy we can now derive the usual formula for the Carnot 
efficiency 

% := 1 - (To/TO (100) 

as an upper bound for the efficiency of a 'heat engine' that undergoes a cyclic process. 
Let us define a thermal reservoir to be a simple system whose work coordinates remains 
unchanged during some process. Consider a combined system consisting of a thermal reser- 
voir and some machine, and an adiabatic process for this combined system. The entropy 
principle says that the total entropy change in this process is 

^'S'machine ~\~ AS Ieservo i r ^ 0. (101) 

Let — Q be the energy change of the reservoir, i.e., if Q > 0, then the reservoir delivers 
energy, otherwise it absorbs energy. If T denotes the temperature of the reservoir at the end 
of the process, then, by the convexity of 5 reS ervoir in U, we have 

^'S'reservoir ^ ~- (102) 

Hence 

AS machinc - | > 0. (103) 
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Let us now couple the machine first to a "high temperature reservoir" which delivers energy 
Qi and reaches a final temperature 2i, and later to a "low temperature reservoir" which 
absorbs energy — Qq and reaches a final temperature T . The whole process is assumed to 
be cyclic for the machine so the entropy changes for the machine in both steps cancel. (It 
returns to its initial state.) Combining IjlOip . (|102|) and (|103|) we obtain 

Qi/Ti + Q /T <0 (104) 

which gives the usual inequality for the efficiency rj := (Qi + Qo)/Qi- 

j] < 1 - (To/TO = ric- (105) 

In text book presentations it is usually assumed that the reservoirs are infinitely large, 
so that their temperature remains unchanged, but formula (|105|) remains valid for finite 
reservoirs, provided T\ and To are properly interpreted, as above. 

Mixing and chemical reactions. The core results of our analysis have now been presented 
and readers satisfied with the entropy principle in the form of Theorem 4 may wish to 
stop at this point. Nevertheless, a nagging doubt will occur to some, because there are 
important adiabatic processes in which systems are not conserved, and these processes are 
not yet covered in the theory. A critical study of the usual texbook treatments should 
convince the reader that this subject is not easy, but in view of the manifold applications 
of thermodynamics to chemistry and biology it is important to tell the whole story and not 
ignore such processes. 

One can formulate the problem as the determination of the additive constants B(T) of 
Theorem 2. As long as we consider only adiabatic processes that preserve the amount of 
each simple system (i.e., such that Eqs. (6) and (8) hold), these constants are indeterminate. 
This is no longer the case, however, if we consider mixing processes and chemical reactions 
(which are not really different, as far as thermodynamics is concerned.) It then becomes 
a nontrivial question whether the additive constants can be chosen in such a way that the 
entropy principle holds. Oddly, this determination turns out to be far more complex, math- 
ematically and physically than the determination of the multiplicative constants (Theorem 
2). In traditional treatments one resorts to gedanken experiments involving idealized devices 
such as 'van t'Hofft boxes' which are made of idealized materials such as 'semipermeable 
membranes' that do not exist in the real world except in an approximate sense in a few 
cases. For the derivation of the entropy principle by this method, however, one needs virtu- 
ally perfect 'semipermeable membranes' for all substances, and it is fair to question whether 
such a precise physical law should be founded on non-existent objects. Fermi, in his famous 
textbook [F], draws attention to this problem, but, like those before him and those after 
him, chooses to ignore it and presses on. We propose a better way. 

What we already know is that every system has a well-defined entropy function, e.g., for 
each T there is Sr, and we know from Theorems 2 and 4 that the multiplicative constants ar 
can been determined in such a way that the sum of the entropies increases in any adiabatic 
process in any compound space Ti X T 2 X .... Thus, if Xi € Tj and Y\ £ Tj then 

(X 1 ,X 2 ,...)^(Y 1 ,Y 2 ,...) if and only if *£A( x i) < E^iOj)- ( 106 ) 

where we have denoted Sr { by Si for short. The additive entropy constants do not matter 
here since each function Si appears on both sides of this inequality. It is important to note 
that this applies even to processes that, in intermediate steps, take one system into another, 
provided the total compound system is the same at the beginning and at the end of the 
process. 

The task is to find constants B(T), one for each state space T, in such a way that the 
entropy defined by 

S(X) := S r (X) + B(T) for X G T (107) 
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satisfies 

S{X) < S(Y) (108) 

whenever 

x ~< Y with ler, YeV. (109) 

Additionally, we require that the newly defined entropy satisfies scaling and additivity under 
composition. Since the initial entropies SrPO already satisfy them, these requirements 
become conditions on the additive constants B(T): 

B(r[ Xl) x if 2) ) = AiBfTO + X 2 B(T 2 ) (110) 

for all state spaces I?!,]^ under considerations and Ai,A2 > 0. Some reflection shows us 
that consistency in the definition of the entropy constants B(T) requires us to consider all 
possible chains of adiabatic processes leading from one space to another via intermediate 
steps. Moreover, the additivity requirement leads us to allow the use of a 'catalyst' in 
these processes, i.e., an auxiliary system, that is recovered at the end, although a state 
change within this system might take place. With this in mind we define quantities F(T, V) 
that incorporate the entropy differences in all such chains leading from r to V. These are 
built up from simpler quantities D(T,V), which measure the entropy differences in one-step 
processes, and E(T,F'), where the 'catalyst' is absent. The precise definitions are as follows. 
First, 

D(T,T') := inf {Sjy{Y) - S r (X) : X e T, Y eV , X <Y) . (Ill) 

If there is no adiabatic process leading from V to V we put D(T,F') = oo. Next, for any 
given T and V we consider all finite chains of state spaces, T = Ti,!^, . . . ,Tn = V such 
that D(Ti,Ti + i) < oo for all i, and we define 

e{t,f') :=inf{ J D(r 1 ,r 2 ) + --- + J D(r J v_ 1 ,r JV )}, (112) 

where the infimum is taken over all such chains linking T with V'. Finally we define 

F(r,V) := inf {E(T x F ,T' x r )} , (113) 

where the infimum is taken over all state spaces IV (These are the 'catalysts'.) 

The definition of the constants F(T, V) involves a threefold infimum and may look some- 
what complicated at this point. The F's, however, possess subadditivity and invariance 
properties that need not hold for the D's and E's, but are essential for an application of the 
Hahn-Banach theorem in the proof of Theorem 7 below. The importance of the F's for the 
problem of the additive constants is made clear by the following theorem. 

Theorem 6 (Constant entropy differences). IfT and V are two state spaces then for 
any two states X £ T and Y £ T' 

X ^Y if and only if Sr{X) + F(T, T') < S T ,(Y). (114) 

Remark. Since F(r,r') < £>(r,r') the theorem is trivially true when F(r,r') = +oo, 
in the sense that there is then no adiabatic process from T to V. The reason for the title 
'constant entropy differences' is that the minimum jump between the entropies Sr(X) and 
Sr'(Y) for X -< Y to be possible is independent of X. An essential ingredient for the proof 
of this theorem is Eq. I|106|) . 

Proof of Theorem 6. The 'only if part is obvious because -F(r, V) < D(T, V 1 ). For the proof 
of the 'if part we shall for simplicity assume that the infima in Ijlllj) . (|112|) and (|113|) are 
minima, i.e., that they are obtained for some chain of spaces and some states in these spaces. 
The general case can be treated very similarly by approximation, using the stability axiom, 
A6. 

We thus assume that 

F(r, r') = d(t x r , r x ) + d^, r 2 ) + • • • + d(t n , V x r ) (115) 
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for some state spaces T , T\, r 2 ,..., T^ and that 

^rx^ro = s(Y 1 )-s Txro (x,x ) = s(Y 1 )-s T (x)-s To (x ) (lie) 

DFi,T i+1 ) = S ri+1 (Y*i) - S ri (Xi) (117) 

^(r^r'xro) = s r>< r (Y,Y ) - s rN (x N ) = s r >(Y) + s ro (Y ) - s Tn (x n ) (ns) 

for states X { G r, and Y { G T i} for % = 0, ...,N, X G T and Y G T' with 

(x,x )^y 1; Xi-<y i+1 fori = i,...,iv-i, ^^(y,^). (119) 

Hence 

F(I\r') = S-h(F) + ^S r ,(y,-) - SKA) - ^ Sr,^-). (120) 

j=0 j=0 

From the assumed inequality Sr(X) + F(r,r') < Sr'(Y) and (jl2()p we conclude that 

N N 

S T (X) + S r {Y) + Y, S rA Y j) ^ S ?(X) + Sr>(Y) + ^Sr j (X j ). (121) 

j=0 j=0 

However, both sides of this inequality can be thought of as the entropy of a state in the 
compound space f :=T x f x To x Ti x ••• x T^. The entropy principle (|106|) for T then 
tell us that 

(X, Y, Y Q , . . . , Y N ) -< (X, Y,X ,..., X N ). (122) 
On the other hand, using (TTTfll) and the axiom A3, we have that 

(X,X ,X U ...,X N ) ~< {Y,Y Q ,Y U ...,Y N ). (123) 

(The left side is here in T x To x Ti x • • • x Tn and the right side in T' x To x Ti x • • • x Tat.) 
By A3 again, we have from l|123|) that 

(X,Y,X ,--- ,X N ) ~< (Y,y,Y ,Yi,-,Yv)- (124) 

(Left side in T x T' x To x Ti x • • • x Tat, right side in T' x V x To x Ti x • • • x Tn.) From 
l|122|) and transitivity of the relation -< we then have 

(X,Y,Y ,Y U ...,Y N ) ■< {Y,Y,Yq,Y x ,...,Y n ), (125) 

and the desired conclusion, X -< Y, follows from the cancellation law ■ 

According to Theorem 6 the determination of the entropy constants B(T) amounts to 
satisfying the inequalities 

-F(T',T) < B(T)-B(T') < F(T,T') (126) 

together with the linearity condition (|ll()p . It is clear that (|126|) can only be satisfied 
with finite constants B(T) and B(T') 7 if F(T,T') > — oo. To exclude the pathological case 
F(r,r') = — oo we introduce our last axiom A16, whose statement requires the following 
definition. 

Definition. A state-space, T is said to be connected to another state-space T' if there are 
states X G T and Y G V, and state spaces Ti, . . . , Tn with states X{, Y% G Ti, i = 1, . . . , N, 
and a state space To with states Xq, Yq G To, such that 

(A,XoHYi, Xi^Y i+ i, i = l,...,N-l, X N ^(Y,Y ). (127) 

A16. Absence of sinks. If T is connected to T' then T' is connected to T. 
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This axiom excludes F(T,T') = — oo because, on general grounds, one always has 

-F(T',T) < F(T,T') . (128) 

(See below.) Hence F(T, V) = — oo (which means, in particular, that T is connected to I"") 
would imply F(V, T) = oo, i.e., that there is no way back from T' to T. This is excluded by 
Axiom 16. 

The quantities F(r, V) have certain properties that allow us to use the Hahn-Banach 
theorem to satisfy the inequalities (|126|) . with constants B(T) that depend linearly on T, in 
the sense of l)110|) . These properties, which follows immediately from the definition, are 

F(r,r) = o (129) 

F(tr,tr') = tF(r,r') fort>o (130) 

F(ri xr 2 ,ri xf 2 ) < F(ri,ri) + F(r 2 ,r' 2 ) (i3i) 

f(t x r ,r' x r ) = F(r,r') foraiir . (132) 

In fact, 1|129|) and (|130p are also shared by the D's and the E's. The 'subadditivity' (|131j) 
holds also for the E's, but the 'translational invariance' l|132|) might only hold for the F's. 
Eq. I|128p . and, more generally, the 'triangle inequality' 

F(r,r") < F(r,r') + F(r' ! r") (133) 

are simple consequences of (|131|) and (|132|) . Using these properties we can now derive 

Theorem 7 (Universal entropy). The additive entropy constants of all systems can be 
calibrated in such a way that the entropy is additive and extensive, and X -< Y implies 
S(X) < S(Y), even when X and Y do not belong to the same state space. 

Proof. The proof is a simple application of the Hahn-Banach theorem. Consider the set S of 
all pairs of state spaces (r,T'). On S we define an equivalence relation by declaring (r,r') 
to be equivalent to (r x To,r' x Tq) for all Tq. Denote by [T, T'] the equivalence class of 
(r, T') and let C be the set of all these equivalence classes. 

On C we define multiplication by scalars and addition in the following way: 



t[T,T>] 
t[Y,T'\ 

o[r,r'] 
[r^r'j + ^r,] 



[tT,tT'\ fort>0 (134) 

[-tV, -tT] for t < (135) 

[r,r] = [r',r'] (136) 

pi xr 2 ,ri xr 2 ]. (137) 



With these operations C becomes a vector space, which is infinite dimensional in general. 
The zero element is the class [T,T] for any T, because by our definition of the equivalence 
relation (T,T) is equivalent to (r x r',r x T'), which in turn is equivalent to (r',T'). Note 
that for the same reason [r',r] is the negative of [T, F']. 
Next, we define a function H on C by 

H([T,T'}) :=F(r,r') (138) 

Because of (|132|) . this function is well defined and it takes values in (—00,00]. Moreover, 
it follows from ifHTfll and lfT3Tll that H is homogeneous, i.e., H(t[T,T']) = tH([T,T'\), and 
subadditive, i.e., H^T^] + [T 2 ,T' 2 ]) < ff([Ti, T[]) + H{[T 2 , T' 2 ]). Likewise, 

G([T,r']) := -F(T',T) (139) 

is homogeneous and superadditive, i.e., GQri,!^] + [r2,r 2 ]) > G([Ti,rj]) + G([r 2 ,r 2 ]). 
By (|128|l we have G < F so, by the Hahn-Banach theorem, there exists a real- valued linear 
function L on £ lying between G and H ; that is 

-F(r', r) < L([r, r']) < F(r, r'). (140) 
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Pick any fixed T and define 

B(T):=L([T xT,T }). (141) 
By linearity, L satisfies L([r,T']) = —L(—[T,T']) = —L([T',T]). We then have 

b(t)-b(t') = l([t xr,r ]) + L([r ,r xr']) = L([r,r']) (142) 

and hence (|126p is satisfied. ■ 

Our final remark concerns the remaining non-uniqueness of the constants B(T). This 
indeterminacy can be traced back to the non-uniqueness of a linear functional lying between 
—F(T',T) and F(T,T') and has two possible sources: One is that some pairs of state-spaces 
r and T' may not be connected, i.e., F(r,r") may be infinite (in which case F(r',r) is also 
infinite by axiom A16). The other is that there might be a true gap, i.e., 

-F(r',r) < F(r,r ; ) (143) 

might hold for some state spaces, even if both sides are finite. 

In nature only states containing the same amount of the chemical elements can be trans- 
formed into each other. Hence .F(r,r') = +00 for many pairs of state spaces, in particular, 
for those that contain different amounts of some chemical element. The constants B(T) are, 
therefore, never unique: For each equivalence class of state spaces (with respect to the rela- 
tion of connectedness) one can define a constant that is arbitrary except for the proviso that 
the constants should be additive and extensive under composition and scaling of systems. In 
our world there are 92 chemical elements (or, strictly speaking, a somewhat larger number, 
N, since one should count different isotopes as different elements), and this leaves us with at 
least 92 free constants that specify the entropy of one gram of each of the chemical elements 
in some specific state. 

The other possible source of non-uniqueness, a nontrivial gap (|143|) for systems with the 
same composition in terms of the chemical elements is, as far as we know, not realized 
in nature, although it is a logical possibility. The true situation seems rather to be the 
following: Every state space T is connected to a distinguished state space 

A(T) = \ 1 T 1 x ■■■ x \ N T N (144) 

where the Tj are the state spaces of one mole of each of the chemical elements, and the 
numbers (Ai, . . . , Xn) specify the amount of each chemical element in T. We have 

A(tr) = tA(r) (145) 

and 

A(r x r') = A(r) x A(r'). (146) 

Moreover (and this is the crucial 'experimental fact'), 

-F(A(r),r) = F(r,A(r)) (147) 

for all r. Note that l)147|) is subject to experimental verification by measuring on the 
one hand entropy differences for processes that synthesize chemical compounds from the 
elements (possibly through many intermediate steps and with the aid of catalysts), and on 
the other hand for processes where chemical compounds are decomposed into the elements. 
This procedure need not invoke any semipermeable membranes. 
It follows from (TT281) ifHEfll and (|T4TI) that 

F(T, T') = F(T, A(r)) + F(A(r),r') (148) 

and 

-F(T',T) = F(T,T') (149) 
for all T' that are connected to T. Moreover, an explicit formula for B(T) can be given: 

B(T) = F(T,A{T). (150) 
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If F(T,V) = oo, then (|126|) holds trivially, while for connected state spaces T and T' we 
have by (TT381) and (fRflll 

B(T) - B(T') = F(T, T') = -F{T', T), (151) 

i.e., the inequalities Ijl26|l are saturated. It is also clear that in this case -B(r) is unique up 
to the choice of arbitrary constants for the fixed systems Ti, . . . ,Tn- The particular choice 
l|15()|) corresponds to putting B(Ti) = for the chemical elements i = 1, . . . , N, 

In conclusion, once the entropy constants for the chemical elements have been fixed and a 
temperature unit has been chosen (to fix the multiplicative constants) the universal entropy 
is completely fixed. 
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2. Some Speculations and Open Problems 

1. As we have stressed, the purpose of the entropy function is to quantify the list of 
equilibrium states that can evolve from other equilibrium states. The evolution can be 
arbitrarily violent, but always S(X) < S(Y) if X ~< Y. Indeed, the early thermodynamicists 
understood the meaning of entropy as defined for equilibrium states. Of course, in the 
real world, one is often close to equilibrium without actually being there, and it makes 
sense to talk about entropy as a function of time, and even space, for situations close to 
equilibrium. We do a similar thing with respect to temperature, which has the same problem 
that temperature is only strictly defined for a homogeneous system in equilibrium. At some 
point the thought arose (and we confess our ignorance about how it arose and by whom) 
that it ought to be possible to define an entropy function rigorously for manifestly non- 
equilibrium states in such a way that the numerical value of this function will increase with 
time as a system goes from one equilibrium state to another. 

Despite the fact that most physicists believe in such a non-equilibrium entropy it has so far 
proved to be impossible to define it in a clearly satisfactory way. (For example Boltzmann's 
famous H-Theorem shows the steady increase of a certain function called H. This, however, 
is not the whole story, as Boltzmann himself knew; for one thing, H ^ S in equilibrium 
(except for ideal gases), and, for another, no one has so far proved the increase without 
making severe assumptions, and then only for a short time interval (cf. [EI])-) Even today, 
there is no universal agreement about what, precisely, one should try to prove (as an example 
of the ongoing discussion, see |LPRj ). 

It is not clear if entropy can be consistently extended to non-equilibrium situations in 
the desired way. After a century and a half of thought, including the rise of the science of 
statistical mechanics as a paradigm (which was not available to the early thermodynamicists 
and, therefore, outside their thoughts), we are far from success. It has to be added, however, 
that a great deal of progress in understanding the problem has been made recently (e.g., 
0). 

If such a concept can be formulated precisely, will it have to involve the notion of atoms 
and statistical mechanical concepts, or can it be defined irrespective of models, as we have 
done for the entropy of equilibrium states? This is the question we pose. 

There are several major problems to be overcome, and we list two of them. 

a. The problem of time reversibility: If the concept is going to depend upon mechanical 
models, we have to account for the fact that both classical and quantum mechanics 
are time reversible. This makes it difficult to construct a mechanical quantity that 
can only increase under classical or quantum mechanical time evolution. Indeed, 
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this problem usually occupies center stage in most discussions of the subject, but it 
might, ultimately, not be the most difficult problem after all. 
b. In our view of the subject, a key role is played by the idea of a more or less arbitrary 
(peaceful or violent) interaction of the system under discussion with the rest of the 
universe whose final result is a change of the system, the change in height of a weight, 
and nothing more. How can one model such an arbitrary interaction in a mechanical 
way? By means of an additional term in the Hamiltonian? That hardly seems like 
a reasonable way to model a sledgehammer that happens to fall on the system or 
a gorilla jumping up and down. Most discussions of entropy increase refer to the 
evolution of systems subject to a dynamical evolution that is usually Hamiltonian 
(possibly time dependent) or a mixture of Hamiltonian and stochastic evolution. 
This can hardly even cope with describing a steam engine, much less a random, 
violent external force. 

As a matter of fact, most people would recognize a) as the important problem, now and 
in the past. In b) we interject a new note, which, to us, is possibly more difficult. There 
are several proposals for a resolution of the irreversibility problem, such as the large number 
(10 23 f» oo) of atoms involved, or the 'sensitive dependence on initial conditions' (one can 
shoot a ball out of a cannon, but it is very difficult to shoot it back into the cannon's mouth). 
Problem b), in contrast, has not received nearly as much attention. 

2. An essential role in our story was played by axioms A4 and A5, which require the 
possiblity of having arbitrarily small samples of a given material and that these small samples 
behave in exactly the same way as a 1 kilogram sample. While this assumption is made in 
everyone's formulation of the second law, we have to recognize that absurdities will arise if 
we push the concept to its extreme. Eventually the atomic nature of matter will reveal itself 
and entropy will cease to have a clear meaning. What protects us is the huge power of ten 
(e.g., 10 23 ) that separates macroscopic physics and the realm of atoms. 

Likewise, a huge power of ten separates time scales that make physical sense in the 
ordinary macroscopic world and time scales (such as 10 25 seconds = 10 7 times the age of the 
universe) which are needed for atomic fluctuations to upset the time evolution one would 
obtain from macroscopic dynamics. One might say that one of the hidden assumptions in 
our (and everyone else's) analysis is that -< is reproducible, i.e., X ~< Y either holds or it 
does not, and there are no hidden stochastic or probabilistic mechanisms that would make 
the list of pairs X -< Y 'fuzzy'. 

One of the burgeoning area of physics research is 'mesoscopics', which deals with the 
interesting properties of tiny pieces of matter that might contain only a million atoms (= 
a cube of 100 atoms on a side) or less. At some point the second law has to get fuzzy and 
a significant open problem is to formulate a fuzzy version of what we have done in |LYlj . 
Of course, no amount of ingenuity with mesoscopic systems is allowed to violate the second 
law on the macroscopic level, and this will have to be taken into account. One possibility 
could be that an entropy function can still be defined for mesoscopic systems but that -< is 
fuzzy, with the consequence that entropy increases only on 'the average', but in a totally 
unpredictable way - so that the occasional decrease of entropy cannot be utilized to violate 
the second law on the macroscopic level. 

There are other problems as well. A simple system, such as a container of hydrogen gas, 
has states described by energy and volume. For a mesoscopic quantity of matter, this may 
not suffice to describe an equilibrium state. Another problem is the meaning of equilibrium 
and the implicit assumption we made that after the (violent) adiabatic process is over the 
system will eventually come to some equilibrium state in a time scale that is short compared 
to the age of the universe. On the mesoscopic level, the achievement of equilibrium may 
be more delicate because a mesoscopic system might never settle down to a state with 
insignificant fluctuations that one would be pleased to call an equilibrium state. 
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To summarize, we have listed two (and there are surely more) areas in which more thought, 
both mathematical and physical, is needed: the extension of the second law and the entropy 
concept to 1) non-equilibrium situations and 2) mesoscopic and even atomic situations. One 
might object that the problems cannot be solved until the 'rules of the game' are made clear, 
but discovering the rules is part of the problem. That is sometimes inherent in mathematical 
physics, and that is one of the intellectual challenges of the field. 



3. Some Remarks About Statistical Mechanics 

We are frequently asked about the connection between our approach to the second law 
of thermodynamics and the statistical mechanical Boltzmann-Gibbs-Maxwell approach. Let 
us make it clear that we value statistical mechanics as much as any physicist. It is a 
powerful tool for understanding physical phenomena and for calculating many quantities, 
especially in systems at or near equilibrium. It is used to calculate entropy, specific and 
latent heats, phase transition properties, transport coefficients and so on, often with good 
accuracy. Important examples abound, such as Max Planck's 1901 realization |P2j that by 
staring into a furnace he could find Avogadro's number, or Linus Pauling's highly accurate 
back-of-the-envelope calculation of the residual entropy of ice |LPj in 1935. But is statistical 
mechanics essential for the second law? 

In any event, it is still beyond anyone's computational ability (except in idealized situ- 
ations) to account for this very precise, essentially infinitely accurate law of physics from 
statistical mechanical principles. No exception has ever been found to the second law of 
thermodynamics — not even a tiny one. Like conservation of energy (the "first" law) the 
existence of a law so precise and so independent of details of models must have a logical 
foundation that is independent of the fact that matter is composed of interacting particles. 
Our aim in |LYlj was to explore that foundation. It was also our aim to try to formulate 
clear statements on the macroscopic level so that statistical mechanics can try to explain 
them in microscopic terms. 

As Albert Einstein put it [E|, "A theory is the more impressive the greater the simplicity 
of its premises is, the more different kinds of things it relates, and the more extended is 
its area of applicability. Therefore the deep impression which classical thermodynamics 
made upon me. It is the only physical theory of universal content concerning which I am 
convinced that, within the framework of the applicability of its basic concepts, it will never 
be overthrown". 

We maintain, that the second law, as understood for equilibrium states of macroscopic 
systems, does not require statistical mechanics, or any other particular mechanics, for its ex- 
istence. It does require certain properties of macroscopic systems, and statistical mechanics 
is one model that, hopefully, can give those properties, such as irreversibility. One should not 
confuse the existence, importance, and usefulness of the Boltzmann-Gibbs-Maxwell theory 
with its necessity on the macroscopic level as far as the second law is concerned. Another 
way to make the point is this: If the statistical mechanics of atoms is essential for the 
second law, then that law must imply something about atoms and their dynamics. Does 
the second law prove the existence of atoms in the way that light scattering, for example, 
tells us what Avogadro's number has to be? Does the law distinguish between classical and 
quantum mechanics? The answer to these and similar questions is "no" and, if there were a 
direct connection, the late 19th-century wars about the existence of atoms would have been 
won much sooner. Alas, there is no such direct connection that we are aware of, despite 
the many examples in which atomic constants make an appearance at the macroscopic level 
such as Planck's radiation formula mentioned above, the Sackur- Tetrode equation, stability 
of matter with Coulomb forces, and so on. The second law, however, is not such an example. 
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